Blog

Post Grabber sniffs out POST data, generates curl scripts

Post Grabber screenshotEvery now and then I find myself needing to automate some web requests, either to download using something a little more robust than a web browser, scrape some web content, or to maintain a session. That automation can be a bit of a pain if there’s a form submission involved, because it means opening up the page source, finding the form and any connected javascript code, and figuring out what fields are submitted.

A little utility I just put together does that for you: Post Grabber detects POST data and generates an equivalent “curl” command that can be used in shell or Automator scripts.

Post Grabber works with its own internal browser, so it can intercept POST submissions directly. That means it works with HTTPS, unlike the traditional web sniffer approach.

Download the app, or see the source on GitHub.

, , , , . Bookmark the permalink. Both comments and trackbacks are currently closed.

3 Comments

  1. Posted April 21, 2011 at 3:51 pm | Permalink

    Wow, this would have saved me about 8 hours of time a few weeks back.

  2. Joel Fernandez
    Posted August 24, 2011 at 2:45 pm | Permalink

    This product is almost perfect.

    Is there an option or a hack to change the User Agent :-)