iPhone 4: Excessive nightly 3G Data Usage while on WiFi

July 21st, 2010

With my new iPhone 4, I thought “I’ll just switch to a 200MB data plan” since I mostly use WiFi and have rarely had a month of greater than 150MB data usage.

What a mistake. With no apps running in the background, Push turned off and Notifications turned off, according to the myWireless AT&T app, my phone is using between 5 and 50 MB of data per night. The usage occurs between 11pm and 3am MT. Upon waking the phone up, it shows it is connected to WiFi, but I get a momentary flicker of the 3G icon. That’s what makes me suspicious it is using 3G instead of WiFi when it goes to sleep. That behavior is contrary to documentation.

Articles and Links

There’s no shortage of material to point at extolling variations of this problem. Some are old — as far back as 2008 — but the post frequency and number of new threads has increased, centered around the iPhone 4 launch and anyone transitioning to a 200MB data plan.

An Apple forum 3+ page post on iPhone 4 using Cellular Data when on standby and connected to wifi.

A MacRumors thread that states “it’s speculated that it’s being sent via 3G because the phone typically is sleeping when this occurs, and iPhone (at least until iOS 4.0) never connects via WiFi while asleep – only via 3G”

The 10 page Apple discussion entitled “Unknown data usage early morning”.

An AT&T forum thread entitled “iphone 2am unauthorized data usage”

Another AT&T thread from 2009 stating similar complaints on iPhone OS 3.0

A claim that it is just a usage tally (which still doesn’t explain the days I never leave the office WiFi).

“iPod touch can stay connected to Wi-Fi when asleep so you can receive incoming VoIP calls and notifications from compatible third-party apps.” So, WiFi should stay connected.

“There’s no word on whether this applies to the iPhone as well (since cellular data is typically persistent anyway), but it would be a nice feature to have in all iOS devices — including iPad, especially when roaming with data turned off, or even just to prevent the delays that usually accompany reconnecting to Wi-Fi based remote control apps.”

Older, 2008 post claiming “Wi-Fi is usually turned off a little while after in standby.”

Conclusion

The only logical explanation is that everyone is just holding it the wrong way, thereby causing it to use more data on 3G than it should.

.
Apple iPhone 4 Press Conference, CSI Miami.png

iBeans Screencast Launched

May 14th, 2010

In concert with my NFJS Tour talks on MuleSoft iBeans, I’ve just released a corresponding 15 minute video on writing an iBean with a quick explanation of the motivations and syntax contributing to this unique lighter-than-ESB platform.

iPad, iPhone Certified Developer Program – A Wild Idea

May 14th, 2010

As much as we (the Software Engineering industry) detest testing and certification, Ben Ellingson and I were wondering if it would be useful to have an Apple iPhone skills-certified developer program. The idea would be that a developer would pass a certain skills test and then be permitted to directly publish bug-fix updates to the store without the usual review waiting period. I realize this is controversial and further cements Apple’s importance in a software release process where many think they should not be involved.

Updated Apache Tomcat Web Application Maven Archetypes via MuleSoft

April 29th, 2010

MuleSoft Tomcat Web App Maven Archetypes

I’m pleased to announce that MuleSoft and I have collaborated to freshen the world’s two most commonly used Maven Web Application Archetypes, the maven-archetype-webapp and the wicket-archetype-quickstart.

The Motivations

These two archetypes had fallen out of date, both in terms of using the new Archetype 2.0 style metadata, as well as in the dependencies on the third-party libraries such as JUnit. Due to limited volunteer developer time, when the Maven Archetype developers moved from the 1.0 to the 2.0 branch many of the existing archetypes did not successfully make the transition. Thus, the public was having to make do by using old versions of these archetypes.

The Update

Given MuleSoft’s and my keen interest in the Apache Tomcat ecosystem, including the enterprise-strength Tcat product, we set out to bring these two aging archetypes up to date. We found that easiest to do under the very open MuleForge repository & GitHub source code hosting for the near term, but we will be submitting a patch to get these improvements back into the core archetypes at Apache too.

Contributing back to community

A week into the effort, the “update” turned into a complete “rewrite” of the archetypes to reap all the benefits of the Maven Archetype Plugin’s version 2.0 features.

The metadata has dramatically changed between the Maven Archetype 1.0 and 2.0 versions of the plugin. Previously, the file named archetype.xml lived in the src/main/resources/META-INF/ directory, then it was relocated to src/main/resources/META-INF/maven, and finally, in full modern 2.0 form, has been additionally renamed to src/main/resources/META-INF/maven/archetype-metadata.xml.

Similarly, variables inside source files were updated to use the ${} notation, with legacy elements like $package updated to ${package}.

The poms for the archetypes were updated from the old archetype plugin type to use the new 2.0 lifecycle extensions

The resultant archetype code is hosted at GitHub for easy viewing, consumption, technical review and forking. We’d love to get your input and improvements!

These two archetypes now represent the most pristine use of the Maven Archetype Plugin v2.0 format.

Integration Tests

We didn’t want to stop at just updating the archetypes though. We wanted to make them better. So one of the most obvious ways to do that was through adding integration tests. I can’t tell you how often I get asked for a good example of leveraging the Maven pre-integration-test and post-integration-test lifecycle events. Up until now, I’ve been relatively empty handed to respond to this request, but finally we have some reference examples.

These lifecycles are now bound to the redeployment and undeployment of the web application artifact (WAR) and the execution of a JWebUnit integration test that exercises and validates the home page on each of the JSP and Wicket flavors of web application.

Instructions for Use

We’ve built a wiki page showcasing the usage of this archetype which we also invite you to review and improve. In short, you can inform Maven of the new archetype catalog via a quick execution of:

mvn archetype:generate -DarchetypeCatalog=http://dist.muleforge.org/maven2/

Lastly, for those of you that prefer a video walkthrough of the usage of these two archetypes, check out our screencast demo that takes you from start to finish of working with these valuable new tools in the Maven, Tomcat, Tcat, and web application development ecosystems.

Future Goals

Like all good developers, we are always looking towards the next iteration, just as the current ones are drawing to successful close. In the next release of these archetypes, or perhaps in supplemental sibling instances, we’re exploring:

  1. A zero-footprint, embedded Tcat installation that can be retrieved from a Maven repository.
  2. Profiles to allow for the integration tests to be selectively executed in a local or embedded Tomcat or Tcat installation, possibly auto-detected to activate the proper profile.
  3. Support for Maven provisioning of completed artifacts into Tcat server groups.

OSS Thanks

In closing, we want to thank the Tomcat community for founding such a great product and the Maven community for planting the seeds of these new archetypes. Java web application development is at its current fevered pitch, thanks, in large part, to these excellent tools and their communities.

A Set of Exciting Conferences

April 4th, 2010

I’m enjoying the privilege of being invited to several large conferences across the globe in 2010. Let me give you a brief overview of these exciting just-attended and upcoming venues…

Scandinavian Developer Conference
Scandinavian Developer Conference

I just wrapped up giving my well heeled Open Source Debugging for Java talk to the wonderful folks at the 2010 Scandinavian Developer Conference in Göteborg, Sweden. Tomas and Lennart were the most wonderful conference hosts and the speaker dinner was world class. The conference was around 700 strong this year, which broke through expectations of growth from 2009. That showcases what a polished event Iptor hosts.

Many stateside colleagues joined me on this trip, including Tim Berglund, Paul Rayner, and Nate Scutta.


Matthew McCullough at GIDS

Great Indian Developer Summit

Next, I’m looking forward to the Great Indian Developer’s Summit in just a few short days from now. I’ll be speaking on a range of topics from iPhone Development for Java Programmers all the way to Dividing and Conquering large datasets with Hadoop. I’ve already been impressed by the helpfulness of the Saltmarch hosts, Usha Karen and Dilip Thomas.


Epicenter, The Irish Software Show

Epicenter

In June, I’ve been invited to the green landscape of Dublin, Ireland to present at Epicenter. I’ll be speaking on iPhone development for Java Programmers once again (a topic I’m passionate and knowledgeable about) in addition to Encryption on the JVM.


UberConf

UberConf

Just one day after returning from Epicenter, I’ll be speaking for four days in my hometown of Denver, Colorado at the newly minted UberConf. It will be a weekday show with a very unique pre-conference workshop (boot camp) on iPad Development for Java Developers. Ben Ellingson will be co-teaching this class with me.

There will be over 100 sessions at this unique conference, which is scale-tipping for an NFJS branded event. There are even registration levels that are all-inclusive, which works great for some corporately sponsored attendees. These unique (and quite successful) packages bundle travel, hotel, meals, registration, and an iPad. You’ll know your exact costs before you even take one step towards an airport.


No Fluff Just Stuff Series

No Fluff Just Stuff Series

And lastly, I’ll continue to present at my favorite recurring conference series, the No Fluff Just Stuff tour. There are at least 15 more stops on the tour this year and I hope to hit most of them. I’m looking forward to meeting up with a lot of the audience members that I had delicious breakfasts, lunches and dinners with in 2009 in the cities where the tour visits.

DOSUG Ignite Talks, Speaker Videos

April 4th, 2010

The Denver Open Source Users Group held an O’Reilly Ignite night in February. We are thankful for Paul Rayner’s volunteering to run the video camera. I’ve just begun stitching the videos together with the animated slides, which turns out to be no easy task. Thank goodness for ScreenFlow. I can’t imagine how hard it would be to assemble a composite video and align the timing without this amazing product. Tom O’Brien, Paul Rayner and Tim Berglund are all now onboard with this amazing and award winning piece of software.

The result of the first stitch of my PresentationPatterns.com talk, entitled “Information Alchemy for Better Presentations” can now be seen on YouTube in HD.

JavaZone 2009 Open Source Debugging Talk

January 27th, 2010

Open Source Debugging in Norway

My Open Source Debugging talk that I gave at JavaZone, Oslo, Norway last September is online and can be watched in Flash format or downloaded as an M4V file. If you were not able to catch this talk at either this venue, or any of the many NoFluffJustStuff.com stops that I gave this talk at last year, give it a try and let me know what you think of it.

AppleScript to Re-Apply Finder Comments

January 25th, 2010

Finder Comments Lost

When restoring from a backup, depending on the Mac-specific intelligence of your backup solution, or when copying files written by a 10.4 Mac, your Spotlight (Finder) Comments stored in the .DS_Store files might not survive the round trip. You’ll first notice this by the fact that your comments field or column is completely empty for files you know you previously tagged or made comments on.

Leopard, Snow Leopard Comment Storage

Tiger and previous editions of Mac OSX store Spotlight comments in the .DS_Store file exclusively. Leopard and Snow Leopard on the other hand, claim to maintain backwards compatibility by storing the Spotlight Comments in both the .DS_Store and the new Extended File Attributes. I question this thinking though, because Mac OSX developer Steve Gehrman of the awesome PathFinder team says that Finder, while it writes both formats, still only reads back the .DS_Store ones. It seems to me that Apple would have changed Finder to read from the newer Extended Attributes as soon as they started writing to those in duplicate.

“On Mac OS X 10.4 Tiger, for example, .DS_Store files also contain the Spotlight comments of all the folder’s files, whereas Mac OS X 10.5 “Leopard” stores this information in Extended file attributes.”

Script Research

Giving a tip of the hat to the similar-but-not-quite-what-I-wanted script that helped me get enough of the syntax working (using type alias instead of type file was tricky) get my own authored, I give you:

A MacOSXHints article, and the corresponding code

The Solution

To solve this extended attributes vs. .DS_Store discrepancy, we only need to read (from the extended attributes) and reapply (thereby recreating the .DS_Store) the same comment. The solution is this AppleScript. Just highlight the files needing the treatment in Finder, then execute this script from the AppleScript Editor.

The result is that Finder (which reads only the .DS_Store files) and PathFinder (which only reads the extended attributes) can both now see the Spotlight Comments.

Extras

If you would like your Mac to automatically clean up the .DS_Store files it writes out to flash sticks and network drives, check out BlueHarvest, an interesting little utility app that fills this need.

What’s the big deal about font choices in presentations?

January 19th, 2010

Fonts and Presentations

Fonts, fonts, fonts. What’s this obsession? For those of us that share a passion for making presentation materials as comprehensible as possible for our students, sandwiched right between a great story and great delivery is a great font.

Reviewing the list

Once you’ve installed Microsoft Office, iWork, or Open Office, you’ll find that you’ve been granted a few (or possibly many) extra fonts installed into your operating system. This is a temptation you should approach carefully, just as you would the edge of a cliff. It is truly a time and design precipice you can fall off of into the abyss.

As you gradually approach this list of fonts, if you obsess over design like I do, you’ll let out an “Ooooooo” as if mesmerized by the quantity of selections you could make. A tool would be perfect here. Let me grant your wish with FontDoc for the Mac and WinFontsView for Windows.

Title versus Body

Now, you have a tool to whittle that list of massive fonts down to size. Let me give you two facets that will chisel it down even further.

First, use a maximum of two Font Faces per presentation. I’ll allow for three if you make judicious use of a handwriting font.

One font should be interesting and story-relevant. It should mesh well with your photography and choice of color in the slides. I’d suggest you primarily use it for titles, strong statements and short phrases. It adds spice to your presentation. Feel the freedom to have fun with your title fonts. I’ve recently styled a presentation on Hadoop with an African theme. I used the Tribeca font in the title and custom rhinoceroses for the bullet points (yes, I used some bullets).

The second (primary) font should be highly legible. I can’t stress that enough. For the portions of your slide deck that people will need to read (and quickly, so they can return mental focus to you), readability is the critical point. I always suggest sticking with a very legible Sans Serif font, as does Garr Reynolds of Presentation Zen Design.

I don’t always obey this rule of Sans Serif in the body, sometimes to my own peril. Fortunately, local audiences in Denver are kind, and remind me that I need to change it back.

Hello Verdana. Really, I didn’t mean to cheat on you! It was just that Aquiline showed up looking so stylish and I just couldn’t help it.

The finalists

The short list of Sans Serif fonts that I printed and put across the room is:

  • Agenda
  • Arial
  • Bitstream
  • Calibri
  • Century Gothic
  • Franklin Gothic
  • Futura
  • Geneva
  • Gill Sans
  • Helvetica
  • Optima
  • Heiti
  • Trebuchet
  • Verdana

I’d suggest you do the same. Also put them up on a projector if you have access to one. Do white font on black. Do black font on white. Notice the affect each font’s nuances have on legibility. Throw up some ranking numbers next to each. That’s precisely what I did. And I asked a few folks to give me their rankings too.

The winner

Helvetica, the Movie
The variant that I (and my scientifically font-polled friends) love the most, is Helvetica Neue. The beautiful part is that it comes preinstalled on many systems these days, but can also be purchased online if you are on a OS or office suite that doesn’t include it.

In the life of a font, you know you’ve arrived when a movie is made about you. Yes, a biographical movie about Helvetica, the font named after Switzerland’s classical name.

Lest you think this is a factor of Steve Jobs and his Apple design shop, I’ll let you in on the secret that this predates the personal computer by several decades. Max Miedinger was the designer behind this font all the way back in 1958!

Conclusion

Give any of these Sans Serif fonts a try (but lean towards Helvetica!) in your next presentation and be sure to gather design feedback from your audience. I think you’ll be pleasantly surprised!

Shameless plug: Keep an eye out in 2010 for the Presentation Patterns book from Neal Ford, Matthew McCullough and Nate Schutta for a complete recipe book with easily digestible presentation improvement hors d’oeuvres like this one.

Denver JUG Hadoop and Encryption Presentations

January 15th, 2010

Denver JUG January Meeting

I had the pleasure of hanging out with about 60 of my local friends at the Denver Java Users Group (DJUG to the locals) on Wednesday night and talking about Encryption on the JVM as well as Hadoop. I had the good fortune of having Andy Sautins of Returnpath.net, who’s an active user of Hadoop, field a few of the questions. I really appreciate the time a few of the folks spent giving me feedback on Speakerrate.com. For your future reference, below are the slides and sample source. Feedback and suggestions are always welcome at matthewm@ambientideas.com

Encryption Bootcamp on the JVM

Abstract

Does your application transmit customer information? Are there fields of sensitive customer data stored in your DB? Can your application be used on insecure networks? If so, you need a working knowledge of encryption and how to leverage Open Source APIs and libraries to make securing your data as easy as possible. Encryption is quickly becoming a developer’s new frontier of responsibility in many data-centric applications.

In today’s data-sensitive and news-sensationalizing world, don’t become the next headline by an inadvertent release of private customer or company data. Secure your persisted, transmitted and in-memory data and learn the terminology you’ll need to navigate the ecosystem of symmetric and public/private key encryption.

Intro to Hadoop

Abstract

Moore’s law has finally hit the wall and CPU speeds have actually decreased in the last few years. The industry is reacting with hardware with an ever-growing number of cores and software that can leverage “grids” of distributed, often commodity, computing resources. But how is a traditional Java developer supposed to easily take advantage of this revolution? The answer is the Apache Hadoop family of projects. Hadoop is a suite of Open Source APIs at the forefront of this grid computing revolution and is considered the absolute gold standard for the divide-and-conquer model of distributed problem crunching. The well-travelled Apache Hadoop framework is currently being leveraged in production by prominent names such as Yahoo, IBM, Amazon, Adobe, AOL, Facebook and Hulu just to name a few.

In this session, you’ll start by learning the vocabulary unique to the distributed computing space. Next, we’ll discover how to shape a problem and processing to fit the Hadoop MapReduce framework. We’ll then examine the incredible auto-replicating, redundant and self-healing HDFS filesystem. Finally, we’ll fire up several Hadoop nodes and watch our calculation process get devoured live by our Hadoop grid. At this talk’s conclusion, you’ll feel equipped to take on any massive data set and processing your employer can throw at you with absolute ease.