What Google App Engine needs to improve, and why I'm [not] moving on [anymore]
Update 9/15: One of the folks on the GAE team saw this! First he gave me more apps. Then he sent me another email saying he "just pushed a change live which should fix deployments so that you actually have 250 (instead of the mysterious 100). Please give this a try and let me know!"
This totally changes things. Wow!
****
I like GAE a lot. But in the end, it's hard to stick with it for major, time-sensitive projects where you don't have a lot of time to waste on workarounds. As a developer, you just don't have enough control over your work.
My biggest troubles:- You can't pack up and leave appspot.com. There is the dev_appserver, which you can use to test locally. But there's no easy, reliable way to run a GAE server clone on your own box. Appdrop, a project that tried to address this, was last updated in 2008 and seems to have fallen behind the new GAE SDK releases (I could understand - what a pain to keep updating). Want to run a GAE clone on EC2? You can't without a lot of work.
- Lots of arbitrary limits. Sure, they were made with good intentions, to improve performance. But you're bound to run into one trap or another with no way out. Max # of files in an app, short timeout for processes, max # of IN queries, etc.
- The local dev server is inadequate for testing. You need to be able to test your app in an environment identical to your production setup. I thought I could get away with using one of my 10 appspot apps as a test app, but I was hitting the max 100 deployments/day limit by 4pm and having to wait until midnight for more quota (and the max 250 deployments that they said is untrue, it's really 100). I had issues with cross-domain requests being treated differently on appspot than on my local server. When you're working with OpenSocial, you find that different social networks are finnicky about cross-domain requests in different, often surprising ways.
- (on Python GAE) If an unsupported library isn't pure Python, you can't use it. Workarounds for this involve using another server, which is irritating. This is often inevitable - when you're starting a project, you often don't know what libraries you're going to need.
- And finally, you can only have 10 apps. So it's inadequate for even little hobby or test projects. As someone who experiments a lot, I usually create (and finish) at least 1-2 mini-projects per week. I've been reusing my appspot apps, but there are ones that I'd like to leave up and running for others to see and use.
I do want to mention that GAE is a really amazing product that just has a few kinks that need to be worked out. The GAE team has made great outreach efforts in the developer community and has always been helpful. And GAE so close to being what I've always wanted.
I'll still use GAE every now and then, and I'm likely to move my OpenSocial app back to GAE in the future. But GAE has too many roadblocks for rapid development. I was spending more time on workarounds than on my actual app. If App Engine were open-source, I could run my own clone of the production server somewhere. I'd be able to get around all the roadblocks and develop my app using their framework and datastore quickly, in a setup basically identical to production, and then I'd be able to come back and optimize it to meet the appspot limitations if I wanted to have their automatic scaling/load balancing. I'd also love to be able to peek under the covers for my own knowledge. Alternately, if App Engine would just let me pay to get around all these issues, I'd get my company's credit card out right now.
