My NCAA teams failed to make it through last month, but there was still a lot of madness for me on the payments-related front. Here’s my mad monthly recap.
I published the first two parts of a four part series on “Selling Digital Goods in Data Markets”. Part 1 focuses upon the early movers and innovators, including a look at features I think are very desirable in a data market. Part 2 discusses selecting a data market and dives deeper into Factual and Infochimps, including how to use Infochimps’ Twitter influence metrics API via YQL. Source code for the Python example is available on GitHub (click here).

Watch for the third and fourth parts of this series to publish to the DevZone soon.
I also wrote the following DevZone blog posts last month:
- “Android apps for money and fame” details how you can enter a PayPal X-powered Android app and potentially win $25,000 in PayPal’s third Developer Challenge; the first critical deadline is May 14th
- “Free PayPal Android webinar” gave readers a heads-up on a PayPal webinar conducted March 30th
- I provided information on how to use PayPal’s new Apigee embeddable console (theorectically skinable but it doesn’t appear PayPal’s done that for theirs)
- “On data markets and YQL gotchas” gives you some pointers on data markets as well as a tip on using external tables in YQL-based applications
- I did not invent Tulsa, but I am a web API lover so in order to #win I suggest REST + JSON
- O’Reilly’s special offer has now expired but you can still make PayPal donations to help the Japanese people via links in this post
- “Amazon Appstore launches, encourages QR code links” introduces Amazon’s new US Android application store and discusses Amazon’s suggestion that developers highlight their in-store apps with QR code linking
- I kicked off a new series on the Twitter APIs with information on how to get started with Twitter’s RESTful interface
Click to read the complete post on the PayPal X Developer Network including links to other important news and information for developers.
PayPal X Platform
- My latest @PayPalX post: Amazon Appstore launches http://bit.ly/gqmC56 and encourages developers to use QR code links #
- Interested in using the realtime web in your @PayPalX app? See the first part of my new @TwitterAPI series: http://bit.ly/f8WckN #
Big data
- Investigate: National Data Catalog http://bit.ly/elMrXZ a one-stop-shop for US government (local, state, and federal) data #bigdata #
- Amazon has launched Cloud Drive http://amzn.to/f1nx5A with 5GB free for the taking #
- Have #bigdata capabilities rendered sampling dead? http://oreil.ly/eToAYj via @radar #
- Overview of text extraction (read: scraping) algorithms http://rww.to/hedJ02 via @rww #
Wireless and mobility
- Developing for #Android with #Eclipse http://bit.ly/gpjCTT includes source on @GitHub http://bit.ly/eAqk9F via @smashingmag #
- Amazon Appstore lets you play with an #Android virtual machine http://engt.co/frH6L1 #
APIs and development
- Are the #Hadoop wars http://bit.ly/fQmA2q death by a thousand startups for @Cloudera? A little tech and some opinion from @gigaom #
- James Gosling refused to join Larry, Prince of Darkness http://bit.ly/eXUVuL and instead opted for Google http://cnet.co/g2hkbQ #
Personal things
- Note to self: Colorado GMU 75/751 map http://bit.ly/hC5X8V #
- Hunters: Nikon "Spot On" ballistics software http://bit.ly/dUl0tU generates free printable hold charts for your scope/ammo/zero combo #
- Internet connectivity issues since last night, with deadlines of course. Argh, Cox! #
- Generate your own Colorado GMU maps http://bit.ly/fyX1Ak via the CO Division of Wildlife #

In my last post I introduced the Twitter REST APIs while sprinkling in a bit of history and providing some information on using Twitter’s Twurl console.
This time I want to highlight some additional development tools to help you be productive programming against Twitter’s APIs. Let’s take a whirlwind tour through hacking Twitter with Apigee’s Twitter console, YQL, Infochimps, and GNIP technologies.
First up, Apigee’s Twitter console. This is similar to the Apigee PayPal and Facebook consoles I’ve written about here before. Apigee’s consoles make API exploration, learning, and call prototyping a quick and easy thing to do. Their Twitter console is a great way to start using the Twitter API immediately, similarly to using Twurl. But if you learn how to use Apigee’s console, you can take the same generalized skills over to other Apigee provided consoles including the PayPal console mentioned above. It’s worth the little bit of time required to get up to speed, in my opinion. Click here to try it out for yourself.
I’ve written a lot about YQL and Infochimps recently, including a how-to on using Infochimps’ Twitter influence metrics API via YQL. YQL allows you to use SQL-like queries to access a wide variety of web APIs including Twitter’s, while Infochimps provides a number of Twitter stream and data related datasets via their data market. I’d encourage you to read my previous posts and articles on both subjects to see how you can use them in your Twitter development.

Click here to read the full article on the PayPal X Developer Network including information on drinking from GNIP-provided Twitter firehose streams and a fantastic O’Reilly book that will give you recipes for hacking on Twitter data.
I’m writing an ongoing series of posts on Mobile, Social, and Local technologies, collectively “MoSoLo“. Previously I’ve covered the rise of web APIs, Facebook (history and openess, social plugins, Open Graph, and the Graph API), web API power tools for programming bliss including YQL for PayPal transactions, data markets, REST+JSON, and more.
In this post I’m going to start exploring the power of 140 little characters at a time: Twitter and its APIs. I’m going to assume you’re familiar with the basic Twitter service and the company behind it; if not, please read through the Twitter Wikipedia page and “A Brief History of Twitter” for background.
By the way if you’re curious as to why Twitter messages (“tweets”) are limited to 140 characters, read “How Twitter Was Born” for the details. The short answer: wireless texting (SMS) limitations, as the service was heavily SMS-oriented in its early days.
Though Twitter has done some things of late that have the developer community and its partners up in arms, it nonetheless has one of the most used RESTful APIs on the web. You can learn from Twitter’s API even if you don’t want to go down the path of partnering with them.
Twitter’s API is explained on their API Documentation page. It includes sections on authenticating using OAuth, a slideshow introducing the Twitter API (@twitterapi), a description of the main Twitter REST API used to access core data including timelines and user information, Twitter Streaming API documentation (this API is used to access near realtime subsets of public Twitter status updates), and information on the RESTful search API that came to Twitter via their acquisition of Summize.
Note that Twitter has chosen the one true web path: REST + JSON +OAuth. This is a very good thing for developers as it helps to make the API simple and easy to use. For instance, to request the 20 most recent status updates (tweets) from the currently authenticated user, you would make the following HTTP GET request:
http://api.twitter.com/version/statuses/user_timeline.format
where format specifies which format you’d like to receive results back in (options include json, xml, rss, or atom) and version specifies the API version for the call. Click here to load this call with JSON response into Twitter’s “Twurl” API console, then click “Send” to see the results for your own authenticated account (you will need a Twitter account for this to work).

Click here to read the full post on the PayPal X Developer Network including another example of the Twitter REST API’s usage.
PayPal X Platform
- Latest @PayPalX blog post: How REST + JSON = #winning http://bit.ly/flwxcW #
- How to make @OReillyMedia purchases & @PayPal donations to help Japan http://bit.ly/fPYViR via my latest @PayPalX DevZone post #
- FYI: @OReillyMedia #Japan special http://oreil.ly/gLhS5Y (50% off ebooks and videos, proceeds to Red Cross) running until $200K raised #
- Recharging prepaid minutes with MinutesTopUp http://bit.ly/hEcfGI built upon @PayPalX and @PrepayNation micropayments #
- Everything you ever wanted to know about the beginnings of "osaifu keitai" (mobile wallet) culture http://bit.ly/hiJo7h via @PayPalX DevZone #
- CTIA keynote: @PayPal mobile transactions exceed $6M per day http://bit.ly/hzJTcL #
Big data
- The first issue of Google's new "Think Quarterly" http://bit.ly/e8mrqB is all about #bigdata http://on.mash.to/ie11Cr #
- How @Groupon uses the cloud the scale its business http://on.mash.to/gLQrRT #
- Request that @Infochimps add a given dataset or API via their customer feedback form here http://bit.ly/eCdmaF #bigdata #
- Data Science Toolkit http://bit.ly/dVFllm deserves investigation; @rww write-up http://rww.to/hy5bDE and @GitHub source http://bit.ly/hK4wjC #
- Love the Data Science Toolkit interfaces, especially the #Python http://bit.ly/eGySde and command line support #
- More on the Data Science Toolkit from the creator's blog http://bit.ly/fHu17L #bigdata #
Wireless and mobility
- Can the mobile wallet beat the hype? http://bit.ly/eJyCrv via @teehanlax (see @PayPalX DevZone at http://bit.ly/92zvHY for more) #
- Nobody needs a tablet. So why are we gobbling them up? http://bit.ly/g7h7vZ via @gadgetlab #
- CEO of @mFoundry on the mobile wallet: “it’s pretty much a goat rodeo until someone sorts it out” http://nyti.ms/eoNrVf #
APIs and development
- A short history of API authentication http://bit.ly/gMoaxv via @apigee #
- Programming is a superpower http://bit.ly/fFUcQq via @acangiano #
- It's official! Download @Firefox 4 from Mozilla http://mzl.la/fvCDn5 #
- Love the "Python Module of the Week" http://bit.ly/eH8apc from @doughellmann (found via Python tips http://oreil.ly/ieKiGx from @barrypj) #
- Hacking RSS using Yahoo Pipes and Postrank http://bit.ly/e7OjG7 (includes #sxsw slides http://slidesha.re/hwEPFJ) via @gigaom #
Personal things
- Handy utility to convert .graffle files to .svg http://bit.ly/ffiv6T #
- To do: Investigate @Skribit http://bit.ly/eIj619 for blog reader topic requests #
- Recipe: Shrimp and Chorizo Paella http://bit.ly/fpe1A8 from @roccodispirito via @runnersworld (yum, must try!) #
Running
- Scientific information on how to improve running economy http://bit.ly/hBOfLf and race nutrition http://bit.ly/exCzk9 via @irunfar #
- Ran 2.71 miles in 30 mins and felt great. Family run pushing the stroller. http://dailymile.com/e/PHw2 #
- Tips and strategies for perfect pacing http://bit.ly/eKYAiC from @runnersworld #
- Ran 5.17 miles in 59 mins and felt great. Six hill repeats pushing a stroller is a real workout! http://dailymile.com/e/PWPV #
- Busting the myths of fat burning http://bit.ly/ejlkPI via @Nectarineimp #
- Ran 4.36 miles in 39 mins and felt tired. Tempo run, fastest mile 8:39. http://dailymile.com/e/Pf6L #
- Ran 3.1 miles in 26 mins and felt great. Refreshing run after a cold snap! http://dailymile.com/e/PjZq #
Amazon has launched their Android application store (aka “Amazon Appstore”) in the US.
Amazon promises to “make it easy to find, discover and buy Android apps”. This is a not-so-slight jab at Google’s Android Market, known for being, shall we say, less than optimal in surfacing the best and most interesting apps. Amazon’s announcement notes:
We are offering a few unique features such as recommendations based on customers’ browse and purchase history. This is one of the automated marketing features we discussed previously. Automated marketing includes placements in search results, browse based results, bestsellers, and more.
Amazon also mentions their Appstore Developer Portal reporting features. The screenshot they provide (see below) shows basic albeit important information on how well your apps are selling, though it would have been great if they’d shown something with more data in it (don’t advertize you’re new with empty screenshots in the future, guys!).
Click here to read the complete post on the PayPal X Developer Network including a info on Amazon’s encouraging developers to link to their Appstore entries with QR codes and a link for more on Apple’s suing Amazon over the name of their market.
This post is a bit of an aside from my usual payments and programming fodder, but I think it’s worthwhile to get the message out since there are some time limits on special O’Reilly and PayPal offers that you may be interested in that benefit Japanese disaster relief.
The first offer: Today’s O’Reilly ebook and video “Deal of the Day” is good for 50% off ebooks and videos, plus all of the proceeds (less author royalties) go to the Japanese Red Cross Society to help in relief efforts. Just shop the O’Reilly store and then use discount code “DDJPN” during the checkout process to save money while at the same time donating to help the Japanese people.
The O’Reilly site notes that they’ve hit $50,000 USD of donations as of 9AM Pacific time. They are hoping for $200,000 USD by the end of the day. This is a great way to pick up a book or video (or several of each!) that you’ve been wanting while helping out.
Similarly, PayPal is crediting transaction fees for donations to a number of charities providing assistance to the Japanese people as they recover from the recent disasters. PayPal will continue crediting these fees through April 10th. If you are in the US you can see a list of available charities by clicking here; if in Canada, you can donate to the Canadian Red Cross here.
PayPal X Platform
- Puzzled why this @Infochimps @YQL query works in the console http://yhoo.it/gYZ17r but not in this Python program http://bit.ly/f8URm9 #
- Ways to donate to Japan earthquake and tsunami relief using @PayPal http://bit.ly/dJXTU3 (100% of your donation goes to charity of choice) #
- This pointer to Python-YQL env info http://bit.ly/hYyCjX from @pjdonnelly solves my earlier "use" problem without the "use" being required #
- Part 2 of @PayPalX "Selling Digital Goods in Data Markets" http://bit.ly/esITZ5 discusses @factual & @infochimps Twitter influence #bigdata #
- Read http://bit.ly/dQ5oUU and http://bit.ly/gVAQGe for more on the @Infochimps Twitter metrics @YQL in @PayPalX article http://bit.ly/fL8jRd #
Big data
- Quora: What underlying technologies are used to implement the major data markets? Answer: http://qr.ae/i6UX #
APIs and development
- "The Node Ahead" http://bit.ly/gNlEjr provides great info including creator Ryan Dahl's JSConf talk on Node: http://bit.ly/eh20qn #
- I hope @factual is talking with @foursquare about cross-walking as part of the latter's "Venue Project" http://on.mash.to/edXsj7 #
- How to optimize your LinkedIn profile's new Skills section http://on.mash.to/gjzMAB #
- #PyCon 2011 sessions are already online http://bit.ly/gB1foJ via @ptwobrussell #
- Presentation: REST API design for SQL programmers http://bit.ly/hBgMjO from @Apigee CTO Greg Brail @gbrail #
- Another great @Apigee post, this one on #winning with JSON and JSONP http://bit.ly/gfz7PG #
- #Python links: "Think Stats" probability and statistics book http://bit.ly/i8g3ce and Milk machine learning toolkit http://bit.ly/ibUC20 #
Personal things
- Move the slider to see before/after photos of Japan's tsunami devastation http://nyti.ms/exUJ74 via @nytimes #prayforjapan #
- 7 simple ways to help the Japanese people http://on.mash.to/gCTfzB #prayforjapan #
- WeatherSpark is fantastic! http://bit.ly/gXKzL4 via @flowingdata #
- An incredible and touching TED talk: "The Birth of a Word" http://bit.ly/fmSbA0 (parents and speech paths *must* watch) via @gnestor #
- Sun domain going away June 1st http://engt.co/eEGUmF is a bit of a bummer; I wonder what it'd cost to buy it for old times sake? #
Running
- My early summer training goal: Turkey Track Trail Half Marathon http://bit.ly/gDf9Ij in CO. Love the San Ju… http://dailymile.com/e/Omf4 #
- More on the Turkey Track Trail marathon races http://bit.ly/i1pXOz via @runnersworld and http://bit.ly/dZY7Za @trailrunnermag #
- Beginning Hal Higdon advanced Half training http://bit.ly/e3nSRS March 21st for the Turkey Track trail race June 11th http://bit.ly/gDf9Ij #
- The Religion of Running Technique http://bit.ly/fy62kN is actually a fantastic, scientifically grounded analysis (via @irunfar) #
- Ran 3.19 miles in 35 mins and felt great. Family run, stroller and all. http://dailymile.com/e/Ox8K #
- Interval training plans to build fitness fast http://bit.ly/gs6Jfk via @activenetwork (I'm curious to try the pyramid on my next "fast" day) #
- Ran 3.34 miles in 29 mins and felt great. 30min tempo run. Warm. http://dailymile.com/e/P2Jc #
- Exercise "afterburn" (aka EPOC) can burn more than a third of your total calorie expenditure http://bit.ly/eRQBLC via @runnersworld #

I’ve written a lot of late about REST and JSON. I hold them dear as being two pillars at the center of good web API design and data delivery.
So I was delighted to read two nice posts on these matters recently on Apigee’s “API Best Practices and Infrastructure” blog.
The first, “REST API design for SQL programmers“, is actually a short slide presentation (accessible via Slideshare here). It walks you through designing a well thought out, simple, easy to use web API when you’re used to thinking in SQL. Apigee CTO Greg Brail (@gbrail) uses an employee database example to show you how to design a RESTful API to access, add, and remove employee data. This presentation is recommended for anyone getting up to speed with REST or especially for someone designing a RESTful API for the first time. Simple and concise, just as it should be.
The second, “Not serving JSON AND JSONP? Then you’re doing it wrong!“, is a blog post from Mr. Brail explaining why we’re seeing such a tremendous rise in JSON and the related JSONP. In a nutshell, this approach leads to smaller messages being sent across the network, very important for anyone doing mobile work. Because JSON is less complicated than many alternatives, this approach often also results in faster parsing and manipulation of the message contents.
Click to read the complete post via the PayPal X Developer Network. Your comments there would be greatly appreciated.

