Ma Siwei, a professor at the School of Computer School of Peking University: immersed media take you through ancient and modern

In the 5G era of all things, media intelligence has become an unstoppable trend and development direction. How does artificial intelligence technology integrate with the media? What media ethical issues will intelligently bring? In the intelligent era, how does the media do the "watcher" of society? Sina News and cover news jointly launched the "Future Media Interview" program intelligent media topic to explore issues related to intelligent media.

Guests in this issue: Ma Siwei, a professor at the School of Computer of Peking University, and a winner of the National Outstanding Youth Science Fund. Mainly study video processing and coding. He has won the first prize of the National Technology Invention Award, the second prize of the National Technology Invention Award, and the second prize of the National Science and Technology Progress Award.

The following is the actual record of the interview:

Moderator: Hello everyone, this is a future media interview program jointly launched by Sina News and cover news. From the small film, we can see that the video technology can be said to be developing in the last thirty or forty years, from black and white to colorful images, from all mosaic VCD discs. The development of high -definition 4K tablets, the development of technology can be said to be endless, so now the more cutting -edge technology is, that is, immersive video experience technology. Today, we are also very honored to invite Professor Ma Siwei of the School of Computer School of Peking University to talk to us about the technology and application of immersive media.

The immersive media we just mentioned, the first time we thought of VR videos, VR games, or earlier 3D movies, then I mentioned above, this is the earliest immersive video experience.

Ma Siwei: First of all, 3D movies are not the first immersive experience. It should be said that the immersion experience is closely related to our technical living standard.

The invention of stereo glasses is very early. In fact, in the 18th century, this three -dimensional vision had been discovered. This three -dimensional glasses were invented. You can use this to watch the three -dimensional painting to get the three -dimensional sense. But earlier, it actually includes we said that in ancient times, there is such a mural in the wall of Lasco France, and after entering such a big scene, there will be a good. This kind of immersion can be said to be this immersion experience of people in ancient times.

Of course, the development of the entire technology is very long. In fact, when the previous technology is relatively backward, and then the feeling of immersion is generally simpler. For example, in the 18th century, people sitting on hot balloons are still a luxury of luxury. Enjoy, how can you provide this sense of experience to the general public? Then someone invented the creation of such a scene, similar to building a building, and then there were some kinds of paintings on it, and then climbed the stairs through people. Then he could see this angle of all angles. Changing, vision can feel different content, I think this is also an immersion experience, similar to the same that we can build various theme parks today. I can get it without going to Paris, but I can build an Eiffel Tower. You can also have this feeling of observing on -site, I think this is a form of immersion.

Moderator: From your introduction, I simply summarize that immersive media has developed a history of nearly 200 years. Its visual experience has always been placed in a primary position. Is it right?

Ma Siwei: It is indeed that vision is very important, because more than 80%of the information obtained by us is from this visual. Of course, the sense of immersion is not provided by vision. In fact, it is us. There are vision, hearing, touch, and smell. In fact, these are the comprehensive immersive feelings.

Moderator: This person's perception is three -dimensional, but vision is still the first and most direct stimulus. What special requirements do this immersive media have for this video, is it the high -definition 4K?

Ma Siwei: In fact, for this immersion of people, the current high -definition 4K is still not enough, but from the video perspective, it is an improvement of this resolution. For example , 16K or even 32K higher resolution; then there is a color. We are still more rich in real world color than our current videos can present this color. The presentation of color can further enhance this immersion.

In addition, there is a sense of visual frame rate. For example, like this video is usually 30 frames per second, but in fact, if the exercise is more severe, we may need a higher frame rate to see to see To be clearer, you can have a better sense of immersion.

I think this is not just a resolution issue. In fact, for this video, there are more other dimensions to improve.

Moderator: The benign development of any industry is inseparable from its norm. I want to immerse the media is no exception, so whether the immersive media also has his own set of standards.

Ma Siwei: In fact, there are many jobs in the standard formulation of standards. On the one hand, international organizations including ISO, IEC, ITU International Telecom Alliance, etc. On the one hand, there are some specialized working groups under it to target immersive media for immersive media. Come on the corresponding standards. Then there is a working group like a working group called the MPEG sports image expert work group, and then he mainly developed related technical standards such as VCD, DVD, and Blu -ray disc. It is also formulating this type of encoding standard for immersive media, and then includes the coding criteria for expressing the form of such videos, as well as the standards of videos plus depth, multi -way video coding standards, and the image include the image including This encoding standard in the form of electric cloud is some of the expressions of the media. There are many standard work in the world. In fact, in our country, we have our own AVS working group. It also focused on the standard of making such video compression. For these standards for compressed transmission of these stitching processing for panoramic videos, of course, these are still in the process of development. At present, there is no uniform standard. Can be supported.

Moderator: We all know that the Olympic Games has adopted 8K live broadcasts now, but for our ordinary audiences, it is actually more clear than 4K. Can you tell us about this? What does this have to do with the immersive experience?

Ma Siwei: 8K can provide a wider perspective, which can indeed enhance this three -dimensional sense. Even if it is just a plane 2D, it is actually said that after the resolution is improved, after 8K goes up, it represents it represents it. The ability to transmit more video information.

We usually say that the original video can be transformed into two videos and three videos. Through many videos, this three -dimensional sense can You can also do other forms of presentation, such as our Olympic Games. The original TV broadcast is what lens is the guide to give you, but after a higher resolution, you can transmit more ones. The content can pass the panoramic video content, and then you can leave the audience to choose this perspective he is interested in, and then see the content he is more interested in. There are many display at this Winter Olympics, such as Gu Ailing, you can see her 360 -degree action, then these things are a form of expression that enhances immersion.

Moderator: Now the audience can go to the scene to watch football games without leaving home. In fact, this provides a very convenient opportunity to enjoy on -site experience after the epidemic. So what I want to know is except for the above scenes, where can the immersive experience be applied?

Ma Siwei: There are many applications for immersive media. Now we are talking more about this kind of immersive cultural tourism. It can be better than going out, or this cultural life experience, and even travel.

Like we now have many digital museums to move some museums and these treasures into virtual reality spaces, you can watch and appreciate it at home, and then have a better sense of presence. There are also this kind of software system after the Burning of the Virgin of Paris, and then the VR system can even return to ancient times. It can also be seen by the Virgin of Paris, and you can even see this kind of Paris Dames that did not be built. I think these are some applications of immersive cultural tourism, including immersive media. There are also many applications in this piece, such as some VR viewing houses now, for example, you can go to see the house without going to the scene. After wearing a helmet, you can also enter a model house that has been decorated. This changes in the style of decoration. I think these are some good applications of immersive media.

Moderator: From a professional perspective, what kind of changes bring in this professional field? Because immersive media can bring strong effects, sometimes it is very impressive, so it is actually very helpful for this kind of education and training.

Ma Siwei: We now have such a job, such as doing training surgery in medical colleges. Of course, you actually let students go to actual human body surgery at the beginning. Form, it can use this relatively simple interactive form, can perform corresponding operations on a bone, and also have a deeper understanding of this person’s physiology. This piece, then we know that there are many such better sports training systems that can directly obtain various parameter information of athletes, can achieve better results and win the championship.

Moderator: We just said that the application and advantages of so many immersive media compared with other media, what are the disadvantages?

Ma Siwei: There are still a lot of problems that immersive media are currently facing. The content production cycle is still relatively long. It is okay to make a short film, but if the large production investment cost is still high, of course, it is also mature with the software and hardware system maturity. It has a big relationship. Moderator: How long is this production cycle? If it is a big production.

Ma Siwei: Big production may be on the year, and the cycle may be relatively long. Even some simple projects may need to be presented for one or two months. One said that this is the high hardware cost, and then the media technology is still in the exploration period, including this technical standards are not uniform, and then there are many solutions. Each company has a plan for each company, but these schemes are between these schemes It is not compatible with each other, and then some content can only be played on some specific devices, so these are some problems facing immersive media development.

Moderator: With the advancement of the network technology, these immersive future media of AR, VR, Yuan Universe, etc. will become a new normal. So what is the current development status of various countries?

Ma Siwei: Regarding immersive media, especially hot words like the Yuan universe, everyone has said a lot now. We know that there are Facebook in the United States now, and then there are many jobs in VR. It is very big, in fact, it also includes Microsoft, etc. It also had HoloLELENS wearing helmets to watch these devices research and development, and then there are many technical accumulation in our domestic immersive media. This media solution of VR/AR, including these companies, cooperates with some museums and some tourist attractions just now.

Moderator: After we finished talking about the country internationally, I remember that in 2016, the two nationwide sessions have been released through VR. So many years have passed. What is the status quo of China's immersive media?

Ma Siwei: Earlier in 2016, it was once known as the first year of VR in China, and then after these 6 years, it was indeed that China has been immersed in media technology. Like this year's Beijing Winter Olympics, this kind of panoramic video broadcast live broadcast is also the collection of our country from the collection of video content to intermediate editing. For example, the terminal presents a lot of these aspects.

In fact, in the past few years, we have a group of key R & D projects in our country. It supports many domestic research institutions and enterprises. There are many new technological progress. Generally speaking, including some hardware equipment and system software development. Blocks have made a lot of progress.

Moderator: So what kind of breakthrough will there be in China's related research in the future according to these development steps you just mentioned?

Ma Siwei: I think the future work is mainly carried out from these aspects. On the one hand, this core algorithm, including the processing and production of the content of the case, needs to be strengthened to strengthen.

Then it also includes this infrastructure. The current data volume of VR and AR content is still relatively large. This 5G is the same as VR and AR transmission. It is still quite challenging. It is relatively high -quality, and it is also 70 or eighty trillion. If it is VR, even the seventy -eighty megers are not enough, so this kind of communication technology communication facilities also need to develop further, so like 6G and so on, etc. These are urgent for VR and AR applications.

Then there are other system software, because we say that our country works on some small software, but in many large system basic software, it is still relatively weak. Strengthen the development of such large system software. Then there is a system like the core. This integration of the core system is also what we need to do in our future work.

Moderator: What kind of benefits can we enjoy through these breakthrough technology.

Ma Siwei: It should be a better life experience, including this culture, education, and medical care. For example, like a cultural life, we may not need to go to the National Theater, but we can also enjoy the one at the scene. Feeling the effect of the performance of music and dance.

For another example, like medical care, through this AR and VR technology, remote medical treatment can enjoy better medical treatment.

Another example is like training and education. Of course, during the epidemic period, our children have been at home for a long time, but everyone knows that this is a relatively simple interaction at present. These are more good lives we can enjoy in the future.

Moderator: Will these be achieved in the short term? Or is there a longer time?

Ma Siwei: I think there is a long -term development process that is estimated to have a long -term development process. Some technologies will be applied to our actual life faster, like more interaction methods, but in the long run, the effect is to slowly improve it. Yes, like wearing 3D glasses, then wearing a heavy helmet, and later wearing a lighter 3D glasses, there will also be a long -term development process.

- END -