Samsung Galaxy S24 Ultra Uses AI to Enhance its Mobile Photography 

Last Updated on December 31, 2023 by SPN Editor

The Samsung Galaxy S24 Ultra is revolutionizing mobile photography with its advanced camera system. It features a four-lens rear camera setup, which includes a 200-megapixel main sensor, a 12-megapixel ultra-wide sensor, a 50-megapixel sensor with a 5x telephoto lens, and a 10-megapixel sensor with a 10x telephoto lens, which makes it the best mobile for mobile photography.

The Samsung Galaxy S24 series, which includes the Galaxy S24, Galaxy S24 Plus, and the Samsung Galaxy S24 Ultra, is anticipated to be launched in the middle of January 2024.

Mobile Photography Features of Samsung S24 Ultra

The device is rumored to offer a 50 MP mode for its 5x telephoto lens, allowing it to produce high-resolution photos of 6120 x 8160 pixels. The 50MP telephoto lens is also expected to support 8K video recording and 5x optical zoom.

On the software side, Samsung is reportedly introducing a new AI feature called the “object-aware engine” to further boost the device’s mobile photography capabilities. With this blend of high-end hardware and cutting-edge software, the Samsung Galaxy S24 Ultra is set to be a dominant force in mobile photography.

The Galaxy S24 Ultra is expected to be equipped with robust AI features that not only enhance the phone’s intelligent functionalities but also provide generative AI capabilities. These capabilities include generating trip itineraries, answering calls on your behalf, and allowing you to skillfully reframe a photograph without requiring extensive Photoshop expertise. Similar features have been observed in the Google Pixel 8 and Pixel 8 Pro with the Magic Editor.

AI is currently the leading trend in the tech industry. As reported by Business Korea (via SamMobile), SK Hynix is developing its “On-sensor AI” that integrates AI capabilities with image sensors. Samsung is pursuing a similar path to become the leading provider of image sensors in the industry, a title currently held by Japan’s Sony. Samsung has already introduced its AI-powered Zoom Anyplace technology, which allows for full-frame 4K video recording along with a zoomed-in portion of that frame.

Zoom Anyplace employs AI technology to automatically follow subjects during close-up shots. Samsung aims to develop “Humanoid Sensors” that can mimic human senses. The company reportedly has a plan leading to the development of AI image sensors capable of detecting invisible things by 2027. Sony, with 54% of the global image sensor market last year according to Counterpoint Research, is the uneasy leader in the industry. Samsung followed with 29%, and SK Hynix has made it into the top five with 5%.

At the SK Hynix TechSummit 2023 event held last month, the Korean chip designer disclosed that it has been integrating an image sensor into an AI chip, enabling data processing at the sensor level. Conventional sensors need to transmit image data to the device’s CPU for computational processing. “On-sensor AI” is anticipated to enhance image quality, decrease processing time, and reduce energy consumption.

A couple of months ago, Samsung held its Samsung System LSI Tech Day in Silicon Valley. At the event, System LSI President Park Yong-in stated that Samsung needs to be a frontrunner in this ‘Proactive AI’ era, which includes leading in Generative AI, high-performance algorithms and technologies, and long-range communication solutions.

How Does AI Improve Mobile Photography?

Artificial Intelligence Technology has revolutionized mobile photography in different ways.

Recognizing Objects and Scenes: AI can discern different objects and scenes within your photos, adjusting the camera settings to best capture the moment. This is particularly useful for optimizing settings for various scenarios, such as capturing the perfect landscape, portrait, or low-light shot.

Enhancing Images: Through the use of sophisticated algorithms, AI can significantly improve the quality of photos. This includes enhancements to color, contrast, and dynamic range. A notable example of this is the powerful ‘night mode’ enabled by AI for superior low-light mobile photography.

Simulating Depth of Field: AI can mimic depth of field to produce a ‘bokeh’ effect, adding an artistic touch to photos by blurring the out-of-focus areas.

Retouching Automatically: AI can automatically touch up images to enhance their overall quality.

Improving Auto-focus: AI has brought significant improvements to auto-focus in smartphones. Modern devices employ phase detection for quicker and more precise focusing.

Implementing HDR+ Technology: Some cameras powered by AI can capture multiple images in quick succession. The AI software then aligns and merges these images into a single, blur-free photo, enhancing mobile photography.

Other Features of Samsung Galaxy S24 AI Phones

The image sensor market, which shrank during the pandemic due to a drop in smartphone sales, is now experiencing a resurgence with demand coming from mobile devices, mixed reality headsets, other extended reality products, autonomous vehicles, and robots. Samsung hopes that the image sensors it equips with AI will be used to enhance mobile photography through mobile cameras found on its smartphones. Applications, Microsoft Innovations, GPT-4, User Experience, Digital Assistants, Google Play, Play Store.

Samsung Electronics is set to revolutionize the smartphone industry with an in-built simultaneous interpretation feature, powered by the device’s internal chips. This feature, known as AI Live Translate Call, will be available on the flagship Galaxy S24 phones, which are expected to be unveiled in January 2024.

Initially, it will support widely spoken languages such as English and Spanish, with plans to include Korean, Japanese, and other languages in the future.

The automatic interpreter will utilize Samsung’s Gauss generative artificial intelligence model and the company’s own processors. It will facilitate bi-directional conversations between various languages with minimal delay.

Interestingly, this feature will function even when communicating with someone using a different brand’s device and can also present the translations as on-screen text.

While most smartphones rely on cloud-based apps for similar features, resulting in lag-filled conversations, Samsung aims to overcome this hurdle with enhanced chip performance that allows call data to be processed directly on the device.