Is Apple’s Ferret the next big thing in Generative AI?
January 8, 2024
If you think an apple is a fruit that can serve as a healthy snack, and that a ferret is a small weasel mammal that can serve as a pet, you are totally correct. However, you may be missing on the latest on AI. Apple, the computer company, is launching Ferret, a game changer and crusader in the generative AI marketplace and technology battlespace. Ferret is Apple’s new AI system with a combination of natural language processing (NLP) and computer vision (CV) capabilities that will rock the AI world in 2024.
Apple has been investing in artificial intelligence (AI) for a long time. Apple recently announced its fine-grained referring transformer (“Ferret”) AI system. Apple’s Ferret combines state-of-the-art natural language processing (NLP) and computer vision. Ferret is like an advanced version of ChatGPT with superhuman computer vision.
Apple’s Ferret system uses the contrasting language-image pretraining vision transformer (CLIP ViT) model to analyze images and convert visual information into AI NLP. Ferret identifies objects, shapes, and other visual details in images. Whatever a human captures as input with a video camera, Ferret can “understand” and process as a superhuman.
In addition to all the NLP tasks that GPT language models can handle and that many humans are already fully familiarized with, Ferret can process visual prompts in a superhuman-like fashion. Ferret understands and follows prompts about specific tiny objects or regions in computer images, combining visual and textual information like a human would. Ferret can locate the proverbial needle pixel in a haystack of billions of pixels. Ferret can provide detailed description of objects, perform face recognition, and all sorts of imagery recognition based on pre-training on large datasets together with the ability to learn more by itself based on lens exposure and experience.
With the integration of NLP and computer vision, Ferret offers AI capabilities considered superior to GPT-4 language models. According to Apple, Ferret beats GPT-4 models in all multidonal features that require integration of NLO and computer vision. Ferret can spot and describe precise regions of images based on textual prompts and can learn to predict prompts. GPT-4 can struggle with small details that Ferret seems to master with ease. According to Apple, Ferret outperformed specialized models like GPT-4 ROI and Google’s Cosmos in all visual recognition parameters. It even exceeded GPT-4 Vision in side-by-side testing on referring expressions.
Ferret’s specialized architecture for NLP CV integration allows it to excel when compared to GPT-4 models. Ferret’s cross-modal comprehension of language recognition with “superhuman” computer vision spells the near future of AI applications. Ferret is said to perform NLP CV integration with extreme focus, accuracy, and detail. As its name implies, Ferret is optimized for fine-grained analysis of images, especially in crowded and complex scenes. The fine-grain models are needle in haystack models designed and built with the precise purpose of locating and describing tiny regions in digital images without problems.
By specializing in human-like super detailed visual recognition and comprehension, Ferret may become a game changer in the generative AI landscape. Ferret can become the framework for AI visual assistants allowing human to see their world differently and extensively more abundantly. Apple can be expected to aim at setting a new standard in AI where NLP human chatbots that can also serve as an extra set of intelligent eyes for humans.
Apple can deploy Ferret into several applications including Siri, the iphone camera, Carplay, virtual reality (VR) / augmented reality (AR) applications, and video games. A Ferret-powered Siri will chat in a human-like fashion with iphone users while leveraging the iphone’s camera to become the new eyes of Siri. Such AI would be able to observe the world around the user, making many visual discoveries and connections that the human may be missing. From expanded memory banks of places visited before to face recognition of acquaintances met before, Ferret may propel Siri into a new era of AI virtual assistance. Apple may also integrate Ferret into Carplay to help drivers navigate roads and streets, serving as extra sets of super smart eyes behind the wheel. Apple may integrate Ferret into VR/AR applications and video games to serve as a super smart, human-like, chatbot with augmented vision and super intelligence.
With Ferret’s state of the art AI features above GPT-4 capabilities, Apple can finally become a serious competitor against Alphabet, Microsoft, and other mega players in the AI landscape. Apple’s Ferret opens a new chapter in the AI Revolution and the AI Era. Stay tuned. The best is yet to come.
Creatix.one, AI for everyone
