Skip to Content

Open the Mac App Store in your browser

I was up late last night building a Mac App Store scraper. In the process I discovered how to browse the store in Safari. Without further ado, let me share the geek.

It turns out you can spoof curl with the Mac App Store user agent to access its data. You'll need to use Terminal for this trick, so if you're uncomfortable with the command line, it's sort of time to skip to the next post.

Still here? Good, let's go.

First, grab and open New & Noteworthy page with the following commands:
curl -silent -A "iMacAppStore/1.0.1 (Macintosh; U; Intel Mac OS X 10.6.7; en) AppleWebKit/533.20.25" 'http://itunes.apple.com/WebObjects/MZStore.woa/wa/viewGrouping?id=29526&mt=12' > ~/Desktop/foo.html; open ~/Desktop/foo.html

Conversely, just open the front page:
curl -silent -A "iMacAppStore/1.0.1 (Macintosh; U; Intel Mac OS X 10.6.7; en) AppleWebKit/533.20.25" 'http://itunes.apple.com/us/genre/mac/id39?mt=12' > ~/Desktop/foo.html; open ~/Desktop/foo.html

The front page doesn't always want to open properly, but if you load another primary page like New & Noteworthy first, it usually loads the way you're looking for.

Some will want to ignore the HTTP status that appears at the top of the webpage -- but they'll probably be using the App itself, so it shouldn't be a problem for everyone else. Have fun!



Categories

OS X

I was up late last night building a Mac App Store scraper. In the process I discovered how to browse the store in Safari. Without...
 

Add a Comment

*0 / 3000 Character Maximum Comment Moderation Enabled. Your comment will appear after it is cleared by an editor.

9 Comments

Filter by:
Ken Collins

Very clever, but why?

July 16 2011 at 5:21 PM Report abuse rate up rate down Reply
markbyrn

How about:

http://itunes.apple.com/us/genre/mac/id39?mt=12

July 16 2011 at 9:05 AM Report abuse rate up rate down Reply
emmerac

If you are not really comfortable with Terminal the free app Kino Worksheet makes it a little bit easier, great for power users too!

http://www.justinsloan.com/pmwiki.php/Pages/Software

July 14 2011 at 8:36 PM Report abuse rate up rate down Reply
Daniel Premo

I didn't do anything special, and this URL works just fine in my browser (Chrome Mac) :

http://itunes.apple.com/WebObjects/MZStore.woa/wa/viewGrouping?id=29526&mt=12

July 14 2011 at 4:59 PM Report abuse rate up rate down Reply
fheusel

why not just change the user-agent in safari using the developer-menu? http://bit.ly/mU9X7L

July 14 2011 at 4:41 PM Report abuse rate up rate down Reply
KevMo

If you have Chrome installed, you can just run the following command:

/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome --user-agent="iMacAppStore/1.0.1 (Macintosh; U; Intel Mac OS X 10.6.7; en) AppleWebKit/533.20.25"

And then paste in the URL.

July 14 2011 at 4:39 PM Report abuse rate up rate down Reply
Dan Knowles

"So come up to the lab and see what's on the slab. I see you shiver with antici.............................................................................................................................................................................................................................................................................................................................................................................................................pation"

July 14 2011 at 4:12 PM Report abuse rate up rate down Reply
1 reply to Dan Knowles's comment
Dan Knowles

.................................................pation."

July 14 2011 at 4:14 PM Report abuse rate up rate down Reply
1 reply to Dan Knowles's comment
Dan Knowles

I've been feverishly checking myself, wish I could turn off that part of my brain.

July 14 2011 at 4:21 PM Report abuse rate up rate down
Buy an ad here

Tweets

© 2012 AOL Inc. All Rights Reserved.