A patent has been filed by Apple for a stylus that can identify colors and texture from real world objects. Patently Apple spotted the application last week, which describes a stylus with a color sensor, light detector, and light emitting inside its pencil tip. According to the patent doc, the stylus can be used to transmit data to external devices, such as an iPad.

According to the patent, the stylus is able to measure texture by detecting lighting and angles. A combination of optical sensors can be used to measure the reflection of an object.

A line drawing taken displaying a pen nib with built-in optical sensors.
Images taken from the patent show at least two built-in sensors located within the nib of a stylus.
Image: Apple

The idea of a pen that can sample colors from the real world has been around for a long time. In addition to being able to reproduce colors in real ink and as a digital swatch, the Scribble pen is also able to match real-world shades with digital color systems. The sensors can be used to recreate long- forgotten paint formulas.

As with all patents and patent applications, there is no guarantee that this concept will become a real Apple product, but I am keeping my fingers crossed, not just because of the possibilities of color sampling with an Apple Pencil, but also because a stylus that can accurately reproduce texture would make my 3 There aren't always suitable options readily available in applications such as ZBrush Being able to quickly and easily copy real-world textures on an iPad could be a game-changer for content creators.

The success of the digital illustration community could lead to more 3D artists using the iPad for content creation.

Given the popularity of the iPad, a souped up Apple Pencil would make sense. If you factor in the laptop or desktop computer needed to run them, the standard iPad and iPad Air are less expensive than drawing tablets from brands like Wacom. The iPad Pro's ability to run illustration software is close to that of desktop graphic design apps. The iPad is lightweight and portable compared to tablets.

Due to the compute demands of 3D software, the iPad has not made a big splash with 3D artists. Improvements are being made quickly with each iPad generation. Forger and Nomad are both iPadOS apps that I use a lot, and both of them run perfectly on my iPad Pro. As demand for 3D assets increases (thanks to the developing metaverse, 3D printers, and video games) iPad and Apple Pencils could soon become a more practical tool for digital sculpting professionals and students.

Many of the patents Apple files never become actual products. In 2015, Apple filed a patent for a stylus that could detect texture, and in 2020 it filed a patent for an Apple Pencil that could watch color. It certainly seems as if the Apple Pencil 2 is due an update. I will be the first person in line to purchase the Apple Pencil if it is released.