You must have seen their works at the bottom of ray media behind VR team

Founded in 2014, Seven Dimension Technology is a technology company specializing in computer graphic images and vision. It provides content production tools such as content production and distribution tools and playback tools. It also has a 360-degree real-time panoramic video stitching technology engine and a VR story engine.

The former provides solutions for 360-degree panoramic video production, supports civilian-level multi-cameras, 4k cameras, and professional movie-grade devices; the latter provides solutions for VR video and game experience problems, including solving multiple VR scenarios and multiple stories. Line and multi-dimensional sound calibration. Consistent with VR, the AR industry solution developed by 7D Technology is also oriented to the enterprise market. Applications include the entertainment, sports, and education industries.

Yin Yuanjiang started this road in 2010. He is the founder and CEO of 7D Technology. He was born in 1982 and graduated from the Computer Department of the University of Waterloo, Canada. He has worked as a senior R&D engineer in Autodesk Canada, Nortel (Nortel) and other companies.

Team: From four people to nearly 90 people

"In the beginning, technology was what I was doing."

Seven-dimensional technology currently has four main core teams. Among them, Li Xiaobo entered the VR industry very early, in 2007, was mainly involved in VR interaction and external hardware equipment related to the main responsible for marketing; Xu Li is responsible for product development; Wen Heng is mainly in content production and content strategy, Served in Crystal Stone and other CG team.

Around 2010, Yin Yuanjiang decided to return to China to start a business and set up a small studio.

From 2001 to 2010, Yin Yuanjiang has been engaged in computer vision work such as graphics and graphics in Canada - editing software for the late stage of media and entertainment in Montreal. In 2010, Yin Yuanjiang returned to China and began to do real-time CG class rendering engines. In 2012, Yin Yuanjiang and the team at that time did the augmented reality of the European Cup “Doraemon Feast” at the radio and television level, such as the appearance of virtual players that could interact with reality in the program. Later, the application of augmented reality has been done now, such as the 2015 Spring Festival Gala, World Cup and other radio and television applications.

At present, there are about 90 members of the 7-dimensional science and technology team, and about 40 people are engaged in research and development. The others are mainly responsible for the production of CG content such as content operation and maintenance.

Compared to Vahana VR, the video processing ability of the latter item is stronger

(Vahana VR screen shot)

Vahana VR abroad has similar parts to Go! Pano Studio:

Vahana VR supports a wide range of video capture and output hardware, including Blackmagic Design's DeckLink series of SDI cards, which can capture real-time 2K/4K 360-degree panoramic video at 30 frames per second; on the output, Vahana VR can output 360-degree by 180-degree video ( Also known as equirectangular format), it adapts to most VR head-mounted displays and 360-degree video platforms including YouTube and Littlstar, and is compatible with custom video players; Vahana VR can also provide bandwidth-limited conditions. Low-latency 360-degree video streaming; Vahana VR can also connect RTMP broadcasts over the Internet and stream video directly to select media servers.

Go!Pano Studio is a 7-dimensional technology that enables real-time seamless stitching and real-time preview. It also supports real-time panoramic cloud broadcast and real-time panorama virtual shooting 360-degree panorama software suite and hardware solutions, covering from content acquisition End-to-end client-wide flow; compatible with GoPro, Drift, Red, Alexa and other professional level and video camera level; support 2-10 mesh panoramic video real-time splicing, local recording and HD-SDI, HDMI signal output, exposure adjustment and white Balance adjustment, real-time panoramic cloud broadcast; can be based on the distortion of the object on the special effects to provide a certain real-time special effects.

Go! Pano Studio has always played an important role in the cooperation between 7D Technology and the platform or content producer. However, Vahana VR also has many customers and agents at home and abroad. How does Seven-Dimensional Technology have to compete with competitors like Vahana VR?

In this regard, Yin Yuanjiang said that 7D technology compared to Vahana VR, in addition to the suture algorithm, out of the previous technology accumulation, can do back-end cloud broadcast and have a stronger post-processing video processing capabilities - such as real-time Toning, processing all video properties such as exposure and white balance, can embed virtual elements in the panoramic video in real time (this item inherits from the previous AR video rendering engine), and achieves more interactions.

Go! Pano's iteration: One-click calibration

(Go!Pano SONY Α7SII-RIG)

The solution Go! Pano has been undergoing R&D since the end of 2014 and now it has undergone many iterations in nearly a year and a half. However, in the latest iteration, “one-key calibration” was not a small breakthrough. It was generally “manual calibration.” ".

Go! Pano itself is a software series that can support different stitching algorithms. Now as long as different algorithms are selected according to different camera combinations, it can automatically calibrate the camera's internal and external parameters, stitching and stitching algorithms, and thus, the visibility range is expanded.

Yin Yuanjiang mentioned that during the development of the Go! Pano solution, the accurate calibration of the camera is a difficult part. Because both the integrated solution and the integrated hardware solution involve the inverse of the camera and the sensor, ie, through the feature points and algorithms, the internal parameters (distortion, FOV, pixel misalignment, etc.) and the external parameters (spatial position, etc.) are reversely determined. ). Reversing more accurately means that stitching and stitching will be more accurate.

Focus on enterprise users in the industry

In terms of the income structure of the 7-dimensional technology, Yin Yuanjiang introduced it mainly into two parts:

For VR-related aspects, we provide Go! Pano-based software and hardware sales, rental, and direct live broadcast service recording and production services for major industry users. In light products, we mainly focus on software sales and licensing. Revenue for 2016 is on the order of tens of millions.

On the other hand, traditional radio and television-level AR services also account for a large proportion of revenue. For example, in the content business such as the “Avenue of Stars”, the Tanabata Gala, and the New Year’s Eve that are currently being conducted by 7D Technology, the cooperative presentation method is AR implantation in high-definition video signals, that is, the augmented reality at the radio and television level. Application of Virtual Studio System in Real-time Visual Effects System of Radio and Television.

In the promotion of broadcasting and television business, video rendering engine is one of the main parts. Yin Yuanjiang mentioned that the video rendering engine is similar to the interactive Hub—video access and output. In interaction, their engine supports a variety of tracking methods, including facial and body tracking. From 2010 to now, its video rendering engine has gradually reached a broadcast-level video signal with no phase difference. On the whole, you can implement keying, compositing, and real-time interactions.

VR/AR Live - "Live Interactive"

For 7D Technology's VR or AR live broadcast of variety shows, Yin Yuanjiang has always called it "live and interactive". "It's not important whether it's virtual reality or augmented reality. The important thing is that most of the shows are live interactive now." He thinks VR There is a difference between AR and AR only in terms of means and approaches. There is no difference in the nature of the technology, because both of them use computer graphics technology.

In 2014, Yin Yuanjiang and his team made a video stitching algorithm Go!Pano. At the same time, AR's business is continuing. Yin Yuanjiang pointed out that their VR video solution actually incorporates many AR aspects, such as real-time implantation of virtual elements in panoramic video. "So, what's the difference? No difference."

However, Yin Yuanjiang also recognizes that the use and presentation of AR will allow it to have broader development prospects and greater application space. However, its technical nature is a computer graphics image recognition technology, and there is no essential difference with VR.

In a sense, the video rendering engine is the bridge between traditional variety shows and new media. This part of the business, they have done four or five years. "The European Cup's giant feast has been done three times - the European Cup, the World Cup, the European Cup, and one round of return." In addition, there are Spring Festival Evening Gala, Hunan Satellite TV, Zhejiang Satellite TV variety shows and many other TV variety shows and network video Companies such as Iqiyi's matchmaking variety shows. "A lot, very much."

The anchor is still the former anchor, but the export has become a VR exit

Yin Yuanjiang introduced that the next development plan of Seven Dimensions Technology is to make 7-dimensional technology solutions and products available to PGCs of the largest and smallest levels. He also said that Seven Dimension Technology will cooperate with several live broadcast platforms to launch a serious VR show. ——Users can be in the same virtual three-dimensional space as the host and conduct communicative operations such as real-time communication and interaction.

At the just-concluded CJ, Huyao lived on the 7D technology to conduct live VR broadcasts. After that, 7D technology also participated in the VR live broadcast including the Big Fish Beggar conference, music charts, and so on. This matter, Yin Yuanjiang, how do I see?

In this regard, Yin Yuanjiang believes that VR live streaming is a fashionable thing, and now the frequency of VR live broadcasts is basically equivalent to the standard, and the direction of the traditional show field is surely to have VR live. Because the male-dominated live-platform user market has a strong demand for stereoscopic anchors, the stereoscopic 3D anchors and interactions are obviously better than the plane experience.

In addition, for the gamification operation to be launched, Yin Yuanjiang also revealed that there are 180-degree stereoscopic shooting hardware and 180-degree stereo synthesis, keying, transmission, and playback-end player algorithms. Content is still from the PGC content of the traditional show. Yes, the anchor is still the former anchor, but the export has become a VR exit.

Many partners

Seven-dimensional technology has a huge partner system, including from CCTV to local radio and television at all levels, from LeTV, Iqiyi to look at the network - or provide shooting equipment or co-production. In its overall solution for customers, it includes the self-developed Go!Pano Studio software core suite and the self-developed hardware solution.

According to the statistics, as early as 2015, RayMedia had acquired 7D and held 40% of the shares. In March of this year, Ray Media’s subsidiary, Ray Films, invested an additional 40 million yuan in 7D Vision Technology. The funds of 7 million yuan were transferred to a 75% of the equity of 7D Technology held by Wang Weijiu, a 7-dimensional technology shareholder. Afterwards, Light Shadow Films purchased its registered capital of 17.61% of Qiwei Technology with its own capital of 33 million yuan. After the transaction is completed, Ray Film will jointly hold a 51% stake in 7D Technology and become its controlling shareholder.

It can be seen that in the VR layout of Ray Media, the role of 7D technology is not simple. According to Yin Yuanjiang, he believes that Danghong Science and 7D Technology are their backbone forces in the layout of the VR media. Among them, the seven-dimensional technology mainly in the acquisition and content source port capabilities, the power of Danghong technology is mainly in transmission and distribution. Danghong Technology has good strength in coding and decoding programs and operations. The coding and decoding algorithms are well-made, which can effectively reduce distortion, save bandwidth, and optimize transmission. Seven-dimensional technology and Danghong technology have strong cooperation in encoding and decoding. For example, many broadcast-level customer solutions are the two of them together.

Chips will not be placed in hardware

"About 2011, what do you think VR can rely on to make money?" At that time, Yin Yuanjiang decided to cut into the VR field from the B-side market. B-end users have relatively high requirements on technical content and interaction and their needs.

In the suture algorithm and other products have reached a relatively mature point, at the same time, the market demand for this level of products also to a certain extent, that is, early this year, 7D technology began to do hardware - will be released in the second half for the C-side VR One Machine - A four-seater panoramic panorama machine that is equivalent to a stand-alone VR camera and can be used for shooting and live broadcasting. Portable products are suitable for light PGC; four Sony products such as a combination of four-one machine products are for severe PGC, so the choice of Sony Alpha seven because it can be manually exposed, the scene also has a stronger adaptability . The latter is suitable for heavy high-quality live broadcasts and is priced at hundreds of thousands of dollars because of the high hardware costs of the Sony camera itself, plus the cost of mobile portable workstations and peripheral accessories. In addition, the panoramic 180-degree stereo integration hardware for the show will soon be on-line.

Yin Yuanjiang clearly knows where his limitations are: In terms of the civil-level two-headed solution, Nikon, Ricoh, etc. have done very well. Although domestic start-ups have a first-mover advantage, they are far behind the traditional technology accumulation. factory. Therefore, the attitude of Seven Dimension Technology for this part of the market is through the way out of ODMs and OEMs for others to disassemble, and will not press on them. Moreover, from the perspective of business operations, this part of the market has small profit margins, fierce competition, and huge risks. At the content level, it is of little significance to produce content for personal use products at the UGC level.

For the offline “experimental” offline experience store in China, Yin Yuanjiang believes that the success of this model depends on whether the content supports it. But in fact, there is no particularly high-quality content. Moreover, low-tech, low-tech experience devices such as "Egg Chairs" will also cause a certain degree of harm to the user's overall experience. As for VR theme parks, there are no lower requirements for the venue. Unlike China and overseas, low land prices in remote areas such as the United States and overseas countries can be affordable for demanding VR theme parks. In China, the situation is completely different or even the opposite.

Platform-driven content production

Several major domestic video platforms have also been involved in VR. Yin Yuanjiang believes that the platform has a driving effect on content production. However, due to the overall input-output ratio, they are now more in the “test water” phase and are putting in quite a bit of law. After the production cycle of a wave of content is completed, the content level should be iterated. But in fact, it is very difficult to make money on the content platform at the moment. So, "The sooner you do it, burn the money earlier." For the recent VR content platform and the entrepreneurial team claimed to make VR interactive content, Yin Yuanjiang has different views. He believes that the interactive content that is being made now is closer to the AB-based selection, and the essence has not changed.

Yin Yuanjiang introduced that the main cost of the 7-dimensional technology currently lies in R&D. As a whole, software development is relatively costly and hardware is mainly spent on mold cost. He believes that hardware and software in the VR field will complement each other. However, the arrival of the first wave of Daydream mobile phones in the fourth quarter or the first quarter of next year will promote the growth of mobile VR users. It is bound to promote the market that hardware will first drive a part of the market; in addition, there is no particularly high-quality VR content.

VR machine positioning

At the beginning of the second half of 2016, quietly appeared some sound VR hardware. Yin Yuanjiang was not surprised. "Natural law." After all, at the beginning of the year or even earlier, VR was too hot and it was time to cool down.

For almost "domestic" VR all-in-one, Yin Yuanjiang described it as "positioning tactics." "The launch of Google's Daydream platform standard is to allow handset manufacturers to upgrade their hardware standards and capabilities to support VR. What is the value of the existence?” If the phone is equipped with a Qualcomm 820 chip and has good performance, then when it is placed in a box, the performance will not be lost to the all-in-one. So, really good.

Second, these startups who make VR all-in-ones actually survive in the cracks. Due to technological gaps and other gaps, they did not do such a company as HTC at the PC level. On the mobile side, the entry of traditional mobile phone manufacturers such as Huawei and Xiaomi made this market even more cruel - it is in the ecological chain and mass production. The natural advantages, and the dependence of mobile VR devices on mobile phones, "As a handset maker, it's not difficult to get out of a box."

The trick is that some of the underlying chips that were introduced this year, such as Intel, have not yet matured their chip processing capabilities to perfectly provide the immersive experience and rendering effects of HTC Vive heavy games; they can only meet the experience requirements of mobile VR or all-in-one machines. , But these two, obviously provide a heavy experience that does not come to the PC level, can tune, is the demand for video viewing. However, watching video, mobile VR is enough, why buy three or four thousand one machine?

The overall industry chain of VR/AR is very large, including computer graphics plus computer vision, optical hardware, sensors, lenses, screens, CPUs, and GPUs, etc. These, Yin Yuanjiang said that currently, overseas levels exceed China's more than a large part. For example, Microsoft's ability to port a considerable portion of the SLAM algorithm to hardware is a level that domestic start-ups can't reach. However, there are differences in terms of applications. First, "China's ability to imitate is very strong." The second is in the VR / AR industry, some of the subdivisions, the domestic team also does a good job, mentioned this, Yin Yuanjiang Incidentally, the seven-dimensional technology in the face of their own animation and tracking set out.

With the occasional vocalization of VR, some people began to compare the decline of 3D TV to the future of VR. However, among the VR entrepreneurs interviewed by the author, it is very certain that someone holds the firm idea that "VR must be the future." Yin Yuanjiang’s attitude is also positive. He believes that although VR/AR's flashpoints will not come soon, they will continue to advance. Microsoft, Google, Oculus, Amazon, Facebook, and many other US Internet companies with a market capitalization of more than 100 billion yuan are all doing VR. These have more professional attitudes and lasting explorations. They are leading the way with bigger patient giants than the capital market - VR. The probability of abortion will be small.

In the current VR field, the outbreak of C-end users needs to take some time, and the B-side market is indeed worth deepening. Yin Yuanjiang leads 7D Technology to continue to deepen the panoramic video software and hardware suites and solutions to produce broadcast-level augmented reality content, provide AR/VR blessings for live broadcasts on traditional programs, and with the support of optical media, the prospects are promising. .

Posted on