My iOS 10 Wish List — So Far
The following comes from my thoughts on what I would like to see in iOS 10 and beyond. Read more here.
I have read a lot of iOS 10 and WWDC wish lists post but none of them have impressed me. Perhaps this is because bloggers are trying to nail the tentpole features of the soon to be announced operating systems, but instead of focusing on just those features, I am going to list everything, BIG or small that I can think of in no particular order. I am sure this list contains some of those proverbial “Nos”, but this is my list of where I would like to see iOS go next and in the future as it continues to evolve in its role as a super computer in your pocket. Here we go…
Camera and Photos
As a photographer somewhere in between a hobbyist and professional, I have always found the iPhone as a camera an intriguing device. Year after year Apple does incredible things with their camera hardware and software. We are reaching the threshold of things a single small lens camera can do, but there is still room too improve and multi-lens cameras are on the horizon. It’s not hard to imagine the iPhones pairing of hardware and software working together only continuing to gain ground on SLR and Mirrorless cameras and photo management software.
Raw Photos and APIs to support editing Raw Photos is another way Apple can further improve the images you can capture with an iPhone. iOS has a plethora of amazing photography apps that are often unique to iOS. Adding Raw Photo capture and editing APIs would greatly increase the quality of those photos and edits on iOS. Apple has already figured out a great system to keep these edits non destructive with extensions and iCloud Photo Library, and the obfuscation of files enables quick conversions of Raw photos into JPEG when sharing to social media apps and the web.
Camera+ is already allowing saving images as TIFFs, but you have to dig to find the setting. I prefer Apple’s Camera.app interface and the Camera+ workflow is probably a bit daunting to most users.
Image Recognition — Faces, Places, & Things
Apple’s stance on privacy may have swung too far to do completely open machine learning on photos, but I think they need to use up some of that user data privacy trust they have been building to work on image recognition. Google Photos has shown what this kind of machine learning can achieve with its fantastic search, but the problem with Google Photos is the Google brand. If Apple were to do image recognition, users would expect the information gained to directly benefit them and the photos to be secure, rather than the potential for photos to be used to improve ad sales. I would absolutely opt in to this.
Follow Up — Tags, Keyword, and Metadata Editing
With the recently launched and excellent Metapho 2.0 came the ability to do most of the tasks listed, however, as a natural extension of making your photos searchable, the data behind them should be editable as well. With my iCloud Library of over 20k photos, Siri is going to need some information about what photo you are requesting, so we will need a way to edit it.
Complete Map View in Photos
One of my favorite features of Photos is to look at the map of where I have been in a given time period. Photos already lets you see the map view, but the caveat is that you can only zoom out as far as years or for specific locations in search. Let us explore our experiences all together in the same view.
Additional Shooting Modes and More Controls
Apple seems to introduce a unique shooting mode each year, and they have perfected simplifying complex shooting modes into the swipe of a finger and a tap of the shutter button. These modes have enabled people with little technical understanding to capture panoramas, slo-mo, time-lapses, HDR, and Live Photos. However, I would like to see more modes added either to the swipe menu (or another mode picker) or enable unique capture modes with manual controls. Slow shutter is one such mode that is simple but would enable a greater breadth of photo capture (fireworks and light trails, long landscape exposures, star trails, etc.) that aren’t currently possible with Camera.app. Apple even opened up manual controls for camera apps with iOS 8, but didn’t add much manual functionality to their own. These controls could be hidden like the option to turn on the rule of thirds grid and video quality in Settings. When enabled, a bi-directional swipe system on the screen could keep the interface simple as many other camera and editing apps have already done. The interface could also be cleaned up by merging shooting modes into something similar to the filters button. Finally, adding in smart shutter capabilities could help improve everyone’s captures by enabling shutters such as big button (tap anywhere on screen to capture image — great for “+” phones), leveling (capture only when camera is level), or anti-motion (capture only when the phone is still enough for lighting conditions and settings). These features will only make the millions and millions (or billions and billions) of photos taken on iPhones even more amazing.
More Editing Tools in Photos
Another thing Apple introduced with Photos in iOS 8 was a remarkably simplified way to edit Light and Color in photos, while still letting more experienced editors fine tune their shots. The problem is, not all corrections are as simple as light and color. I would love to see a “Detail” slider that corrects for sharpening and noise, as well as making photos softer or more dramatic. Improve the color slider dropdown options to enable advanced color corrections. Steal Adobe’s new content aware cropping. Bring over the retouching brush as well as maybe a few other brushes like burn and dodge. Pair this with Raw photo capture, the built in non destructive editing, and the best photo app ecosystem in existence, and iOS becomes the go to place to capture and edit photos.
With the revamp to Notes.app and the iCloud backend last year I was almost an instant convert. I am not lying when I say it helped me be more productive than ever through by far the hardest year of college. Greedily, I want it to continue to improve rather than go years without further improvements.
Image and Document Markup
One baffling omission from Notes.app last year was the ability to mark up images and documents within your notes, while adding fantastic yet simple drawing tools. If I only got to choose one feature to add to Notes this year this would be it (though I have plenty more). I would love to see the drawing tools be able to markup images and documents rather than simply the blank canvas we currently have.
More Drawing Tools and Drawing Tool Extensions
On the heels of asking for the drawing tools to be able to markup documents, I would love to see more drawing tools. Paper really nails a lot of these tools in a fairly simple interface. In addition they could add markup tools which they already have in Mail.app to round out their annotation tools. On top of adding native tools, they could also create an extension point that lets developers add drawing, annotation, OCR, and PDF markup tools within notes itself to further extend the types of notes one can capture.
Note Types and Formatting Options
Not all notes are created equal, and we need to remember and recall all sorts of information. Yes there are “Apps for that”, but having a single environment to put all the information you want to remember in makes searching easier. Note types could include things like a simple sticky note (colors could correspond with tags), data tables, marked up documents, sketches, and lists. The iOS version also needs font formatting to change size and color like its Mac counterpart.
Tags and Better Note/Folder Management
Adding a little metadata via tags would also be a great addition. Tags could match the OS X (macOS) version, sync via iCloud, and be pervasive throughout both operating systems adding an easy way to find all documents and information relating to that tag.
One of the features that sold me on Notes versus Evernote was the ability to infinitely nest folders. However, you can only go multiple folders deep on the macOS version of Notes. I would like to see this feature be implemented to not only Notes, but Photo folders, iCloud app folders, etc.
Another glaring omission was the ability to share Notes and Folders with others. This may be an upcoming feature but it seems odd in light of the ability to share calendars, reminder lists, and shared iCloud albums (which I would prefer be part of iCloud Photo Library in the Photos’ Albums tab). Sending carefully formatted Notes to friends and family shouldn’t result in that formatting being lost, and being able to share within Notes.app solves the problem of lost formatting.
The addition of password protected, encrypted notes in iOS 9.3 was a great surprise and welcome feature for all of us privacy minded nerds who watch family members store sensitive data and passwords in Notes.app. However, only Notes containing text, photos, and sketches are able to be locked. So storing sensitive documents in Notes doesn’t currently work, and leads to your outboard brain being fragmented across apps.
Additional Card Data Types
Currently Messages displays cards for some but not all data types. If it can be shared via messages and isn’t plain text, the attachment should be able to display in a nicely laid out card. This could include things like notes as mentioned above, webpages, weather information, and potentially 3rd party defined data via an API for defining data types. With the importance of understanding what types of data apps can provide and handle being necessary for Siri, Apple could extend these definitions into visual representations of their data and kill two birds with one stone. Imagine sending a Dark Sky forecast to a friend that is also viewable when you ask for the weather in the Siri interface. Not only could rich visualization convey better information, but it could additionally lead to support of developers via app purchases.
Stickers and Attachments
The current state of 3rd party keyboards is divided into two very different functions. The first is what was intended by Apple when enabling keyboard extensions, and that is an alternate way to enter text into the message (or data field). The second use of keyboard apps is to add attachments into your messages, but the process of toggling through keyboards is convoluted and always leads me to uninstalling all 3rd party keyboards. I have seen a lot of suggestions for how to fix 3rd party keyboards, but I think the model is simpler than a lot of these proposed solutions. Allow for text input keyboards to replace the default keyboard, and add in an attachment extension for stickers, gifs, and other attachment keyboard types. This could include or replace the camera (though I would leave it separate) and the audio attachment buttons already in place. Security prompts for these two different systems could reflect the need of the extension and would make me feel better about granting Refresh rather than Full Access to a random gif keyboard maker. Then we can all send our friends and families Kimoji stickers and not have to worry about ever finding our default keyboard again.
While we are adding attachments, I think instead of shooting the dead horse of Digital Touch on Apple Watch, Apple should include the drawing feature as an additional native extension along with photo, video, and voice. There are 3rd party apps that imitate this feature, but if implemented natively we could then receive the digital drawings on our Apple Watches without them looking like bad stick drawings.
Apple Pay Money Transfers
One of the Tent Pole rumored features of iOS 10 that I am completely on board with is Apple Pay enabled money transfers via iMessages. I am a big believer in food and drink karma, but it never hurts to be able to easily send cash to friends and family. Full steam ahead on this one.
I am a diehard RSS reader but I like the idea of a news or article reader that enables me to discover more about the topics I am interested in even if they aren’t linked within an article I have read. However, News is currently limited to a single thread. Not only does this make curating my own discovery on a topic difficult, but it adds noise to that process. One way to solve this would be to allow users to make folders or “Magazines” of sources and topics. For instance if I want to read up on photography or backpacking, I could place certain sources and topics within that folder, which I could choose to read from with a dropdown at the top of the For You screen. This way I can discover great backpacking tips without seeing a headline about Donald Trump, which makes me instantly want to leave the app. Apple could anonymize data about the stories I like that are grouped together and use it to make suggestions to other users with similar interests.
Improved Topic Recognition and Discovery
In addition to magazines, topic recognition and discovery could use some work. Since everything in News is being fed into the app purposely, Apple should absolutely be using machine learning and human oversight to classify the basic topic of an article. I have seen some terrible unrelated keywords attached to articles and that does not give me much confidence that it will provide me with quality recommendations.
Once we have solid classification of what an article is about, it would be a boon to be able to mute a topic out of your News feed. The Internet can become flooded with a single topic such as an election, celebrity death, missing airplane, or sporting event and seeing endless articles about the same topic that you are uninterested in can be frustrating. Simple topic mutes would solve for this, and a modal pop up from tapping on the topic box could “snooze” the topic for varied intervals of time or indefinitely
Reading List and Read It Later
Apple News already comes with a bookmark feature which is probably a part of the recommendation engine, but there is potential for it to learn from other sources as well that perhaps aren’t in Apple news. Apple could integrate Reading List into its recommendation engine, and potentially create a share extension that enabled you to feed items and topics to it to further learn about your interests.
Read To Me
Like M.G. Siegler, I listen to a majority of what I “read” on the internet. Apple’s addition of the Speak Screen gesture has only amplified how much I listen, as it makes enabling text to speech a breeze. However, News is not optimized for the feature and the page frequently jumps side to side if you are trying to follow along. I would love to tell Siri to “read this article to me”, completely hands free, or for there to be an action extension to Read to Me. It would be another huge accessibility win for Apple.
Maps.app has been rapidly improving since its controversial launch. That said, there are still lots of areas for improvement. Map and location data will be an important aspect for a digital assistant that helps to run our lives. I hope to see some of the following come to iOS 10.
Trail Support — For Bikes and Hikes
One area that many tech companies struggle with in their Maps apps is coverage of both cycling and hiking trails. I am sure the data is much more difficult, time consuming, and costly to obtain, but through user sourcing and satellite imagery verification, trails could be mapped. This would enable an entirely new set of directions for Maps.app.
Apple has already collected topographic information for Maps to use in their 3D rendering that they overlay satellite imagery on top of (this is not the same as Flyover). Adding topography further increases the amount of information that users can gain from looking at Maps and would enable 3rd party outdoor recreation apps to provide users with topographic data without integrating Google Maps (which has basic topography) or paying for access to expensive topographical map databases.
Can you tell I sometimes hike to remote locations yet? Adding offline maps and APIs for 3rd parties to offer downloadable maps would allow users to explore and be directed through regions that may not have the best (or no) internet connection. Saving could be as simple as zooming the screen to the appropriate coverage area and tapping an action extension to save full detail of whats on your screen. Additionally, when traveling, offline maps are a great way to save on data and pairs perfectly with my next request.
Have you ever wanted to plan a trip and save points of interest to visit that you don’t want to miss? Itineraries would make your iPhone much more capable at being your travel guide. Being able to save the itinerary on the device with all points of interest, directions, and a copy of the offline map would help you save data when traveling internationally or in areas with poor or no internet connection. And with the Proactive features introduced with iOS 9, itinerary items could be delivered to you based on your location or schedule to keep you on track. Seeing an overview of your entire trip can make planning much easier, and it is a great way to recall the amazing vacation you took 5 years ago. Other features like geotagged photos you’ve taken in the past, propagating on your overview, could help you find that secret spot you wanted to revisit.
Better User Correction Tools
Help me help you Apple. Maps started out with some holes in its data, but over the years it has gotten much better, in no small part because of user submitted corrections. But the tools could still be better. A feature that enabled users to submit road and trail information when a road or trail is either incorrect or missing could enable better coverage of new or unmapped paths. Information could be verified with geotagged photos or videos. There are millions of iPhones and iPads in use, and I am sure there are plenty of willing explorers that would love to help Apple improve its data.
Continuous Updates to Satellite Imagery
In the past 5 years both of my sisters have moved into developing neighborhoods. Maps’ satellite imagery has frequently lagged behind on these developments by more than a year or two. Perhaps this is a political issue, but human’s change their landscape and it is important to be able to convey that information. It also helps user’s submit proper corrections, which helps to improve the directions maps can deliver. Apple probably has the cash on hand that launching a satellite isn’t out of the realm of possibility, and good map data will be very important for that not so secret car.
Literally everyone else is doing some sort of snoozes, because sometimes we just don’t have time to deal with the increasing amount of email we get, and sometimes, things are not pertinent until later. Mailbox (RIP) nailed snoozes on its introduction and Mail.app should revive its style and ease of use. I personally use Outlook for work email because it has snoozes in addition to being a decent cross platform app that I can put users on, both iOS and Android for their work email.
Rules & Automation
One feature that the iOS version of Mail lacks is the ability to apply rules to senders and subjects. Yes, rules can be applied elsewhere, but as we live on our mobile devices more and more, we should have the capability to apply rules and other automation (such as unsubscribing) to our email.
Mail.app has limited access to extensions, most of which are through third party keyboards or when dealing with attachments. I want to be able to use extensions even on emails that do not include attachments such as exporting messages to other apps and services without literally forwarding email to said services.
As part of indexing everything to make Siri and search more powerful, I would love to see tags come to mail. This way I could have tags on Notes, Photos, Mail Messages, Documents, etc. and be able to quickly view everything about a subject by just searching for that tag. Better yet, with automation, tags could be applied automatically like Proactive suggested calendar events so that you would always have all of the possible information about that subject at your fingertips.
Games and Game Center
Yes, I actually want Apple to do something with Game Center other than shut it down.
Make Game Center the Home of Games — Remove Games from the App Store
I love apps for what they enable me to do. And I am a huge gamer, both hardcore (my play time in Destiny would make most parents weep) and casual games. That being said, I think each needs its own respective home. Breaking games out of the App Store and putting them in Game Center could have numerous positive effects, and each store could get its own set of rules about purchases, returns, and ratings. I think as Apple thinks about how to make development of non-game applications sustainable, one thing that would greatly increase visibility for apps would be to let them stand apart from their game counterparts. Currently on the featured page there are 93 games (one single app store category) and 77 apps (24 app store categories). I am positive this is part of the discoverability problem for apps and game makers who struggle to stay visible. Games obviously are a big part of the platform and at 93–77 probably warrant their own store front.
Game Center itself has never been loved by Apple. Perhaps it is a lost cause to try to make it anything functional, but it can’t hurt to give it at least one more shot. Better match making, game discovery, messaging and chat, and dare I say streaming could all make it a much better platform for gaming.
Centralized Game Credits
Before my day kids used to earn an allowance and then spend it all at arcades. Now, that allowance for some is given as iTunes credit which is then spent entirely on in app purchases. Something that could save the sanctity of games from freemium currency based games would be to reinvent the arcade token system. The game review team could dictate acceptable play earned per token so game developers did not abuse in app purchases as many do today. Terms could even give developers a better revenue split akin to subscriptions. I think Apple should try anything they can to kill in app purchase of currency. Alternatively, instead of credits, Apple could flat out ban the use of currency which is often set up in a way to make purchases with in game currency require additional purchase of currency, because the user’s left over balance is inadequate for multiple purchases (selling 10 packs of currency, and requiring 6 currency per purchase).
Release Chess.app for iOS
Many of the problems Apple has with games spawn from Apple having no skin in the game. They need to have a game that uses Game Center so they can learn its faults and triumphs. This could lead to better match-making, better tools, better top charts (cheating is rampant), and a general better overall experience. If they are interested in other original content beyond radio, television series and movies, perhaps they could work with quality indie game developers to publish games like Threes, Monument Valley, Alto’s Adventure, Ridiculous Fishing, Flappy Bird, Crossy Road, etc. Perhaps then they would realize that despite their best efforts there is a flourishing game platform on iOS.
#iCloud and iCloud Drive
Since it’s inception, iCloud has had a black eye. Unreliability, dysfunctionality, and inaccessibility plagued certain iCloud services. But year after year Apple has taken meager steps towards making all of iCloud a competent product. It’s time to start competing in cloud services in all arenas and to do so with user data privacy and security in mind.
Copy the Best Parts of Google Drive and Dropbox — Shared Folders, Collaboration, Version History, App Integrations
Collaboration is nonexistent on iCloud. Yes there is the ability to share documents, but opening a link on an iOS device comically tells you that collaboration is only available on Mac and PC browsers and does not open in one of the installed iWork apps. Shared links are ugly and long. There is no folder sharing for collaborating. Etcetera, etcetera, etcetera. iCloud drive should resemble a modern day cloud storage application with features to share documents easily and securely, full collaboration on devices Apple claims you can get work done on, easily accessible version histories, and much more. COPY GOOGLE AND DROPBOX!
Once again make everything tag-able. Siri will thank us later.
Audio iBooks and “Read to Me”
Apple recently moved Audiobooks out of iTunes and into iBooks. One of the appeals of digital books is their ability to do more than regular books. It would be great to be able to have the stories come to life with Audiobooks with all the visual aids available by creators in iBooks. And if there is no audiobook version available give us better controls for the Speak Screen settings in iBooks (or in general) and let us request of Siri to “Read to Me”.
Once again, Apple half supports an important feature in an iOS version of its apps. Both .epub and .ibooks books can be marked up with highlights and notes, but PDFs are left purely to be viewed. I at the very least want text selectable PDFs to gain the notation features of its siblings in iBooks, but perhaps we could gain full mark up for everything in iBooks (with Apple Pencil support as the cherry on top) for all three file types. This would bring iBooks on iOS up to snuff with the abilities of Preview on the Mac since Apple seems reluctant to release preview for iOS.