What is the use of Xiaomi’s 100 million pixels?


Editor’s Note: This article is from the WeChat public account “Love Fan” (ID: ifanr), author Liang Menglin, 36 氪 authorized to reprint.On November 5th, Xiaomi released Xiaomi CC9 at the new product launch conference, which is also the second mobile phone of Xiaomi with 100 million pixel sensor.Speaking of 100 million pixels, the first thing that people think of is the medium format camera that is active in major studios and photography studios.These shovel can only be quietly supported on a tripod, which is difficult for ordinary people to use.Even if Fuji introduces the more popular GFX series, its price and operation still have certain thresholds, and the public may not be able to accept it.Fuji GFX-100 proofs, single JPEG volume up to 80MB More importantly, a single 100 million pixel photo is large.A photo takes up tens of megabytes of space, and it is inconvenient to transfer and share.So few people will buy a 100 million-pixel camera to record their lives. These cameras will only appear in professional shooting.Nowadays, the Xiaomi mobile phone equipped with Samsung sensor brings 100 million pixels to the mobile phone photo circle, which attracts the public’s attention and also raises the upper limit of the mobile phone photography pixel.However, for the public, even if the mobile phone uses 100 million pixels, it still does not know where it is strong, and it is not clear what it means.So, today we will come to explain to you, what is the use of 100 million pixels used by Xiaomi this time?100 million pixels, where is the meaning?To talk about 100 million pixels, you should start with Samsung’s sensor.As early as August 12, Samsung released a sensor that supports 1080 billion pixels of ISOCELL Bright HMX, which is the first sensor in the mobile phone ring to reach 100 million pixels.As the world’s first billion-level CMOS, the ISOCELL Bright HMX features a 1 / 1.33-inch outsole design.Although the sensor size is smaller than the 1/1.2-inch 4100-pixel CMOS sensor used in the Nokia 808, the ISOCELL Bright HMX is still larger than the popular 1/2-inch high-pixel mobile CMOS such as the Samsung GW1 and the Sony IMX486.The three pixels of the three sensors are all 0.8μm in size, and the pixel size has not changed. The change is the size of the sensor.As far as the current CMOS development is concerned, the volume of CMOS is equivalent to the volume of a bowl. Each pixel is equal to each grain. Under the same size of rice, a larger bowl can hold more rice.Then it is equivalent to a larger base, and more pixels can be stacked under the same single pixel area.ISOCELL Bright HMX also supports Tetracell’s four-pixel synthesis technology, which can increase the single-pixel photosensitive area by four-pixel synthesis of one large pixel to enhance the imaging performance under low light.Of course, like other high-pixel cameras, it still takes pictures in the 27-megapixel mode every day. There are only one special shooting mode in 100 million pixels, which needs to be manually turned on to use.After learning about the ISOCELL Bright HMX sensor, I believe many users will ask: “I usually record life, what is the use of 100 million pixel shooting mode for me?” It is really not necessary to use 100 million pixels on weekdays.necessary.For mobile phone users, the meaning of high pixels is actually zooming in.There are more pixels, which means that there is more room for zooming in and another way to achieve high zoom.If the user wants to shoot distant objects, there are high pixels to do the basis of the enlargement, and the shots will be clearer.In this case, manufacturers do not need to spend more time on the phone’s telephoto lens and zoom.With the high-pixel sensor and the corresponding optimization algorithm, the mobile phone can enhance the digital zoom effect.In addition, the 100 million pixel sensor can output 27 million pixels after four pixels.In this low light environment, the camera pixels will not be too low, which is good for retaining the details of the picture.Compared with the Samsung GM1 with 12 megapixels left after four pixels, the 27 million pixels actually have a bit of digital zoom.If there is a user who wants to do further zooming or zooming, the 27-megapixel ISOCELL Bright HMX will still meet the demand, which is also the advantage of high pixels.Overall, ISOCELL Bright HMX brings 100 million pixels to mobile phones, mainly to give users more digital zoom space.Although the ISOCELL Bright HMX’s pixel and sensor sizes are larger than the previous high-pixel sensors, it satisfies the needs of people and vendors for marketing parameters.Shooting in 100 million pixel mode, the resolution and detail of the photos are stronger than 64 million pixels and 48 million pixels.But if you only understand from the perspective of actual experience and use, these are not the key points that ISOCELL Bright HMX needs to highlight.With the simplest digital zoom, it brings higher magnification to the mobile phone users, and also reduces the cost of developing and using the telephoto and zoom lenses of the mobile phone. This is the core of the high-pixel sensor.After replacing 100 million pixels, will the mobile phone camera become better?This is a question that many users will ask.For digital photos, pixels are one of the core factors in determining image quality.The size of the total number of pixels, which determines the size of the photo, will also affect the image resolution.As Ai Faner mentioned in the evaluation of Xiaomi CC9 Pro, in the case of good light, 100 million pixels will bring a great resolution advantage over the mainstream 12 million pixels and 48 million pixels, 12 million if you lookProbably, 48 million is a clear view, the details of the 100 million pixel exaggeration point, can be said to overflow the screen.At this time, if you look at the magnified picture, you can see the obvious advantages.Blurring effect contrast proof; Xiaomi CC9 Pro (left) and iPhone XS (right) In addition, CELL Bright HMX increases the sensor size to 1/1.3 in order to install this billion pixels with a single pixel size.After the sensor area becomes larger, the equivalent coefficient will also change.After the equivalent coefficient changes, the angle of view and depth of field effect of the shot will also be affected.As can be seen from the figure, the Xiaomi CC9 Pro and the iPhone XS have no blurring effect when the distance between the objects is the same, and the Xiaomi CC9 Pro can also see some blurring effects.Here, it is the effect of the sensor size becoming larger.Although it is not directly related to pixel enhancement, CELL Bright HMX increases the size of the sensor in order to increase the total number of pixels. This is also a function of increasing the total number of pixels.The depth of field change is actually a by-product of the sensor size change. The biggest highlight of the CELL Bright HMX sensor is actually the improvement of image clarity and resolution.Without magnifying, the details on the windows on the surface of the building, as well as the texture on the outer wall.27 million pixels, 108 million full pixels said so many high-pixels can bring better image resolution and larger image information, but the pictures taken by high-pixel, the look and feel will be better?Not necessarily.27 million pixel screenshots 108 million pixel screenshots can also be seen in the same set of proofs, Xiaomi CC9 Pro in the 108 million full-pixel mode can not turn on automatic HDR and other image processing effects.Without the aid of these algorithms, the latitude of the 108 million full-pixel mode is generally versatile, and the processing of the dark position is not as good as the 27-megapixel 4-in-1 mode.In addition to the outstanding resolution and detail processing, the whole photo is relatively flat. The space that can be adjusted later is not necessarily more than the 27 million pixel four-in-one mode, so the photo look may not be more than 27 million pixels.The pattern is good.This is actually a trade-off.Because of the large amount of information on these high-pixel photos of 48 million, 64 million, and 100 million pixels, mobile phones are more difficult to handle.Therefore, in order to reduce the processing pressure of the mobile phone, the mobile phone also reduces the use of the algorithm in the high pixel mode, and the processing effect is naturally not as obvious as in the low pixel mode.In this way, the high-pixel mode is like a child with a partiality. The resolving power and detailing are the things they are good at, and the performance will be more prominent. However, other latitudes and other needs that need to be algorithm-assisted, it may not be likeThe four-in-one pixel mode comes comprehensive.This is one of the reasons why the look and feel of the photo may not be better than the normal mode after the high pixel mode is turned on.How big is the difference from the camera?With a larger 100-megapixel sensor, does the phone have the ability to challenge the camera camp?In order to understand the difference between high pixel and camera, we also made a simple comparison between Canon EOS 5D Mark iii and Xiaomi CC9 Pro.Xiaomi CC9 ProEOS 5D Mark iii In the comparison proofs we can see that the Xiaomi CC9 Pro with the 100 million pixel sensor has a good performance in image resolution, and this is the EOS 5D with a 24 megapixel full-frame sensor.Mark iii The gap is not too big.However, after zooming in on the screen, you will find that the details of the EOS 5D Mark iii will be clearer than the Xiaomi CC9 Pro.Like the lines on the leaves, the EOS 5D Mark iii can be clearly preserved, but the Xiaomi CC9 Pro is rather vague.It should be clear here that the EOS 5D Mark iii is not a full-frame, high-pixel body. If it is more than pixel and image resolution, it has little advantage.If you want to replace the EOS 5DS series like the same door or Nikon D8X0 and Sony α7R series and other high-pixel body, the camera’s advantages will come more obvious.Xiaomi CC9 ProEOS 5D Mark iii In addition, the overall details of the EOS 5D Mark iii will be much better than the Xiaomi CC9 Pro. The details of the hair on the Pikachu, EOS 5D Mark iii are also made clearer.After all, the difference in sensor size is there.With the optical advantage of the lens, even if the mobile phone uses a sensor with a larger amount of pixels, it still can’t move the camera, and the gap is still there.Therefore, it is still the same sentence: the bottom of the level, really can crush people.Fuji’s “welcome map” after the Xiaomi conference, may use a more intuitive way to tell users the truth.Algorithm, outsole, high pixel, who is the future of mobile photography from 32 million to 48 million, and then from 64 million to 100 million pixels, pixel enhancement has become a key development direction of mobile phone photography.The larger total amount of pixels gives the user more room for zooming in and digital zoom, allowing them to take longer shots without a telephoto lens.As the total number of pixels increases, the size of the sensor also grows larger.After replacing the sensor with a larger photosensitive area, the mobile phone camera can also obtain better shooting results.With the advancement of image algorithms, most people can also take good-looking photos on their mobile phones.This is one of the reasons why more and more people use mobile phones to shoot.Excellent AI processing and image algorithms can enhance the look and feel of the picture, but also reduce the threshold of photography.Like Apple and Google, when the algorithm is good enough, the average person can take a good photo with a simple shutter on the premise that the composition is not a problem.In addition, the mobile phone can also improve its ability to shoot at night through algorithms, and can also simulate the blur effect of the camera with a large aperture lens.However, the improvement of the algorithm can not break through the bottleneck on the hardware.Just like algorithmic simulation, the phone can only capture the blur effect of a camera with a large aperture lens.However, if you want to enlarge the contrast, the blur effect of the mobile phone processing is still natural without the camera. These are the physical gaps.However, if you only consider lifting pixels or increasing the sensor area, this road may not be able to go too far.From today’s comparison, we can see that increasing the pixel is only to improve the image resolution, or to bring more digital zoom to the user.But if you want to enhance the overall look and feel of the picture, it is not enough to just raise the pixels.In addition, as the pixels increase, the size of the image increases, which also causes inconvenience for storage, sharing, and subsequent processing.In addition, the ever-increasing sensors are also affecting the form of mobile phones.When the manufacturer chooses a larger sensor, the entire rear camera module such as the camera lens will continue to grow larger.This rule, we can also see from the rear lens changes of the iPhone 5s, iPhone 6, and iPhone 7, as the body becomes thinner and the CMOS size becomes larger and larger, the degree of camera bulging becomes more and more obvious:As can be seen from the chart, during the evolution of the iPhone 5S to iPhone XS, the lens area is becoming more and more obvious as the sensor area increases.Obviously, the oversized CMOS does not meet the design requirements of the thinner the phone.In addition to the iPhone, we can find other extreme examples.For example, Panasonic has released a CM1 mobile phone, which is a 1-inch CMOS mobile phone. The sensor size is the same as that of the Sony “black card”, which is much larger than the current mobile phone.However, the rear lens of the Panasonic CM1 is much larger than the common mobile phone. When taking pictures, the CM1 is basically the same as the conventional card machine.Although the quality of the shooting will be better than other mobile phones, but the design is thick and heavy, and the storage is far less convenient than the current mobile phone. Finally, Panasonic has to give up the idea.Therefore, increasing the pixel size or increasing the size of the sensor, or separately improving the quality of the algorithm, is a certain improvement for the camera.However, if only a single item is raised, there will still be a bottleneck.Only by merging all three together and making progress together, can we further enhance the ability of the mobile phone to achieve a better balance..