AI enters the film and television industry: algorithm reengineering Li Jiaqi


Editor’s note: This article is from the micro-channel public number “machine that it can” (ID: almosthuman2017), Author: Qin force, authorized release krypton 36.”Virtual avatars” on TV are not uncommon, and lifelike Samsung “virtual people” may break your perception.Behind the recruitment of doctoral students of drama artificial intelligence in Chinese drama, artificial intelligence has been targeted at the application and research of film and television production.In Hollywood, filmmakers have used AI to predict the box office of a movie.From on-screen to off-screen, AI is changing the film and television industry.Soon after opening in 2020, the AI ​​and film and television industries are welcoming new changes.At the CES, Samsung showed the “artificial man” NEON project. No matter in temperament, language, movement, expression, it is no different from real people, and even the hairstyle, eyes and lip details are vivid.This “virtual image” that appears on the screen is not uncommon, but it can make people feel dark about these “virtual people”.Without paying any attention, you will mistakenly think that these life-sized stewardesses, commentators, yoga instructors, etc. are coming to you from the screen.From the fantasy world created by Hollywood blockbusters to the various “virtual figures” that appear on TV screens.Artificial intelligence-driven computer multimedia technology and three-dimensional animation technology bring many novel experiences to human beings.Recently, the news of “Driving in Artificial Intelligence for Drama in Chinese Drama” has broken people’s imagination about film and television production. Whether it is virtual characters, simulated characters, or post-editing, special effects design, artificial intelligence is accelerating the development of the industry.From on-screen to off-screen, we are also concerned that in Hollywood, filmmakers have used AI to predict the box office of a movie.Film and television is an art form that realizes comprehensive visual and auditory appreciation with the purpose of screen and screen projection.With the development of artificial intelligence technology, technologies such as speech recognition and computer vision in the context of deep learning are changing the film and television industry.Artificial intelligence in movies is entering our world, and they will become part of our lives, such as becoming virtual news anchors, virtual receptionists, and even movie stars made by AI.Those hot “screen killers” For the past year, we have been screened by the avatars behind various screens.From the “virtual man”, virtual host, virtual idol displayed by Samsung at CES, even people will use AI algorithms to re-create the next “Li Jiaqi”.At CES, you might be shocked by Samsung’s “man-made people” who are virtual characters who live on various screens and look lifelike.This dummy is from Samsung’s NEON project.Samsung NEON is an artificial intelligence-driven virtual existence. The technology behind it is two STAR Labs’ patented platforms: CORE R3 (responsible for appearance, intuitive reality) and SPECTRA under development (responsible for intelligence, learning, emotion andMemory).This is the “Digital Virtual Man” project launched by Samsung with great fanfare this year.The temperament, language, movements and expressions displayed by each virtual person on the screen are different, and they are very vivid and lifelike, especially the details of the eyes and lips. Basically, no computer-synthesized details can be seen.The purpose of Samsung’s manufacturing of virtual image design is to better adapt to the work of all walks of life in human society, such as financial experts, movie stars, news broadcasters, fitness coaches, hotel waiters and so on.Jobs in all walks of life can be replaced by virtual images. For example, virtual newscasters have become a reality.Companies such as Baidu, Sohu, and HKUST have launched “virtual moderators” for broadcasting news this year.With the blessing of AI technology, virtual hosts can save time and costs required for news production.Live bloggers don’t care.HKUST Xunfei once used AI to synthesize a virtual anchor image of “Li Jiaqi”. After multiple training, this “AI Li Jiaqi” can also “sell goods” in a righteous manner.This requires the use of artificial intelligence technologies such as speech synthesis, image processing, and machine translation to enable real-time broadcast in multiple languages ​​and support automatic output from text to video.In the near future, we may see more real avatars from all walks of life appear in front of us, not just virtual hosts.Various types of virtual animation images, virtual idols, etc. have appeared on various live broadcast websites in large numbers.To organize a feast of virtual anchors with rich roles can’t be simpler.In the animation anchor program, only one face of an anime character can be used to synthesize various facial and head motion animations.As the technology for synthesizing moving images has progressed, apps featuring “AI face-changing technology” have also become popular.In the film and television works, netizens turned Su Daqiang, who was so irritating in the TV series “It’s Fine”, changed his face with AI into Wu Yanzu’s eyebrows. He could also play a corner of Huang Rong played by Zhu Yin in “The Heroes of the Condor Heroes”Replace it with Yang Mi.Face synthesis, as a branch of the highly sought after field of artificial intelligence, brings many novel experiences to human beings.Infiltrating the film and television industry chain Artificial intelligence is becoming more and more mainstream and penetrates multiple chains in the film and television industry.In Hollywood, filmmakers have used AI to predict the box office of a movie.Recently, Warner signed a contract with artificial intelligence technology company Cinelytic to use the latter’s artificial intelligence project management system.Perform predictive analysis during film planning. This system can measure the value of actors in various fields, which films are suitable for which film stars, and can calculate how many films should be launched, etc., and a movie in the theater and other auxiliary channels.Expected income.Warner’s “The Joker” swept the world’s $ 1 billion and became one of the most profitable films of the year. Warner also had a lot of failed works last year, including “Godzilla: King of the Monsters”, “Hell Kitchen”, and “Murder”.Although AI may not be able to predict the next Clown, it will reduce the time that movie decision makers spend on low-value, repetitive tasks and help them make better decisions.In addition to Cinelytic, there are many companies doing similar jobs.Belgian startup ScriptBook can predict if a movie will sell out by analyzing the script.Israeli startup Vault focuses on the analysis of the trailer data to predict which people are more willing to watch the feature film.Another company, Pilot, is working on a similar project, claiming to “accurately predict” box office data for 18 months before the movie’s release.During the film production process, the producer needs to make important decisions on the core elements of the film, such as screenwriter, script, director and cast, and evaluate the cost, genre, market, box office and audience of the film.For a long time, the script after adaptation or creation can become a film script.But now this work can be done by artificial intelligence.According to previous reports, an artificial intelligence program called “Benjamin” can write short films for science fiction movies. It can even write its own style of music episodes after learning 30,000 popular songs.Another example is IBM’s artificial intelligence system Watson. After systematically learning the pictures, sounds, and creative composition of 100 horror movie trailers, it can mimic the structure of the script to help movie staff make movie trailers for Fox’s sci-fi movie “Morgan”., Reducing production time from 10 days to 1 month to 24 hours.Why does film and television need AI?Specifically in the whole process of film and television production, artificial intelligence plays a great role in script, editing, and special effects processing.The types of film and television content are very complex, such as character scenes, natural scenes, historical scenes, imaginary scenes, etc. Based on the conventional content production methods, it still requires huge capital, labor and time costs.The automatic generation of scenes by AI can be regarded as a gospel for the film and television industry, which can not only improve the designer’s work efficiency, but also greatly reduce the soaring production costs of the industry.AI is disrupting the film and television industry, and its performance is in reducing production costs, grasping the psychology of the audience, and predicting and analyzing the value and quality of film and television.The application of artificial intelligence in the talent market for film and television production has become an industry trend.At the same time, the application of AI in the film and television industry also needs to face another realistic problem: talents, whether in the early or late stages, the number of talents is still far from meeting the needs of market development.At present, the talent gap in the film and television post-production industry has reached about 200,000, among which the special effects editor, column packer, and micro-film production are the most lacking.As technologies such as artificial intelligence-based speech recognition and computer vision gradually penetrate the film and television industry, fewer people have this skill.Most of the institutions that deliver this talent are universities, film and television training bases, or training institutions.Judging from the enrollment of doctoral students in drama and music by the two universities, artificial intelligence has targeted the application and research of film and television production.For the first time, China Opera recruited a PhD candidate in Drama Artificial Intelligence.Requirements for doctoral candidates for artificial intelligence include: candidates for science and engineering who are interested in the subject of “drama and film and television”, priority should be given to candidates with a cross-disciplinary background or strong interdisciplinary ability; have a strong sense of innovation and scientific research,Provide representative works (including papers, software, game development, publications, etc.) or original work results that can reflect their academic level, scientific research ability, and practical ability.Huang Guixiang, the producer of the artificial intelligence series documentary “Exploring Artificial Intelligence 2”, once told the media that artificial intelligence is also an industry trend in the field of film and television production and stage performance. At the same time, there is also a shortage of talents.I also thought about the specific application of artificial intelligence to program production. For example, we wanted to design Yang Lan’s artificial virtual image, including Yang Lan’s voice dubbing and other intelligence, but it was not put into operation as soon as possible due to cycle, funding, and manpower.Exploring the development space of artificial intelligence in the art field, the Central Academy of Drama is not the first.The Central Conservatory of Music has released an enrollment note for PhD in Music Artificial Intelligence.The full name of this major is “Music Artificial Intelligence and Music Information Technology”, which was first established for the Central Conservatory of Music.Mentor + technology mentor), and strive to cultivate ‘composite top-notch innovative talents with the integration of music and science and engineering.’According to the official website of the Central Conservatory of Music, the professional system of “musical artificial intelligence and music information technology” is 3 years, and candidates are required to be candidates from computer, intelligence and electronic information.At present, the first batch of doctoral students of the Central Conservatory of Music has successfully recruited students.However, it is not clear what the two universities’ research directions for artificial intelligence doctoral students are, but talents in this direction are still scarce.Whether it is a virtual character, a simulated character, or stage design, data imaging, including post-editing, film and television production, artificial intelligence-based speech recognition, and computer vision technology, there is still much room for imagination..

Tags : EntrepreneurshipInternet entrepreneurshipInternet entrepreneurship project