Hardik Pandya CGI Character during left everyone surprised

Interactive Tech

Pallavi Rakhecha

4 min

Nov 19, 2024

Broadcasting in sports is no longer limited to static scoreboards and simple player stats. With the adoption of cutting-edge CGI (Computer-Generated Imagery) technologies, broadcasters can engage audiences through immersive visuals. For Star Sports, the transition from traditional 2D elements to AR CGI wasn’t just a technological leap—it was a step towards revolutionizing sports storytelling. The Genesis of AR CGI for Star Sports Star Sports, a leader in the Indian Sports broadcasting industry, is known for being a visionary in adopting innovative tech in broadcast.

During IPL 2024, Star Sports set a new objective – find a way to captivate live sports audiences through immersive technology. Ink In Caps, as the tech enablers of the campaign, got the mandate to enhance traditional broadcasts, making them interactive and visually compelling without the need for additional devices like VR headsets or AR-enabled mobile screens. We came up with the idea of shifting the broadcast elements—such as player scores, track records, and player details—from 2D to 3D basically, a pipeline to convert all these 2D assets into hyper-realistic 3D models of cricket players directly within live broadcasts.

The Concept

At this point, CGI technology was becoming popular, especially during the World Cup. We proposed creating short, 10-15 second CGI clips featuring cricket players. However, there was a challenge—security restrictions meant we couldn't shoot the players in person, and we only had access to stock footage.

To create the 3D models, we needed reference photos of the players, and these photos had to capture multiple poses for accurate modeling. Despite these constraints, we were able to overcome the challenge and successfully build the 3D models of the players.

The Next Step- Broadcast Integration

We then proposed developing a library of 3D player models, along with various animations, that could be used for different tournaments. To achieve this, we devised a comprehensive pipeline, detailing every step of the process: which software would be used for hair, eyes, jerseys, and how to handle the complex task of converting 2D player data into 3D assets.

In IPL 2024, we introduced photorealistic AR CGI avatars of 15 cricket players directly into 74 live match broadcasts, revolutionizing sports broadcasting. This innovation scaled globally for the ICC World Cup, where lifelike CGI representations of 22 international cricket stars captivated over 500 million viewers worldwide. Each avatar was meticulously designed, capturing even the smallest nuances of the players—from Virat Kohli’s powerful stance to Pat Cummins’ smooth bowling action.

Building the Technology: Tools, Software, and Tech Stack

Key Tools & Software

Blender: This open-source software played a pivotal role in our pipeline. Blender helped us model and texture the 3D characters. For the World Cup project, we found Blender to be particularly useful for its powerful lighting system, which allowed for easy adjustments and real-time tweaking of character features.
ZBrush: ZBrush was used to refine the characters' details, such as facial features and body proportions. This software was key for adding realistic detail to the models, especially when we were limited by stock footage and reference photos.
Character Creator: To streamline the character creation process, we introduced Character Creator. This software allowed us to build base meshes for the characters quickly. It reduced the time required for character creation from 10-15 days per character to just 2-3 days.
Maya: Maya was used for hair creation. Using the card system, we manually created hair by handling thousands of polygons, an essential task in creating realistic, high-quality hair.
Substance Painter & Photoshop: These tools were used for texturing the characters. Substance Painter was particularly helpful in adding details and realistic textures to the skin, clothes, and other features of the characters.
Unreal Engine: For the IPL broadcasts, we used Unreal Engine, which offered more flexibility in adjusting the lighting and textures in real time. Unreal's real-time rendering capabilities made it ideal for integrating the 3D models into live broadcasts.

The Pipeline Process

Our pipeline evolved from a traditional 3D modeling process into a highly streamlined and efficient system. Here's a breakdown:

Initial Model Creation: Using software like Character Creator, we would create a base mesh for the character. This was the starting point for modeling.
Refinement and Detailing: We would then take the base model to ZBrush to refine the features, ensuring they matched the real player's proportions and facial features.
Hair Creation: Hair was manually created in Maya, where we used the card system to generate realistic hair flow.
Texturing: After the model was fully shaped, the next step was texturing. We used Substance Painter and Photoshop to paint details onto the model, ensuring it looked as lifelike as possible.
Rigging and Animation: Once the texture was applied, we rigged the character for animation. This was done in Blender, where we used a combination of tools to make the character move realistically.
Real-Time Integration: For live broadcasts, we developed custom software to integrate the 3D models into the broadcast pipeline seamlessly. This software allowed the director to choose which player to display, select animations, adjust lighting, and push it directly into the broadcast.

Challenges: Overcoming Technical Obstacles

Photo Dependency and Rapid Turnaround

One of our biggest challenges was the limited photo reference we had for each player. To combat this, we developed a system to quickly generate 3D models from a single photo.

Realistic Lighting and Shadows

Lighting was another major challenge. To make the CGI players blend into the live footage seamlessly, we had to match the lighting in the environment. Whether it was day or night, the lighting on our 3D models had to match the broadcast footage to maintain realism. The Unreal Engine allowed us to adjust lighting on the fly, ensuring the CGI characters looked integrated into the live footage.

Sync Issues and Real-Time Feed

During the World Cup, we faced sync issues due to the match being played outside of India, with separate directors handling the footage. To address this, we used Black Magic for video signal processing and real-time feed synchronization. Our custom-built hardware and sync cables ensured that there was no delay in the footage, which was crucial for live broadcasting.

AR CGI vs. Traditional CGI

The term “AR CGI” refers to the process of combining real-world footage with computer-generated 3D elements in real time, without the need for specialized AR hardware. This is different from traditional CGI, which often requires pre-rendered scenes or physical shooting of actors.

In traditional CGI, 3D elements are rendered and integrated into footage during post-production. However, in AR CGI, the 3D elements are overlaid on live footage in real time, making them feel as if they exist within the same environment. In our case, we used live sports footage and placed virtual players into the scene using AR CGI, adjusting the lighting and shadows in real-time for a realistic effect.

Scaling and Refining the Process

We are constantly refining our pipeline to reduce manual effort and improve the quality of the CGI characters. For upcoming tournaments like the Test Series, we plan to update the player jerseys and create new animations. The goal is to eventually shift from 2D to 3D assets in all aspects of broadcast, including pre-show and post-show segments.

We are also exploring new tools and technologies, such as automated hair creation systems, to further optimize the process. Our aim is to make AR CGI more seamless and efficient, reducing turnaround time while increasing the quality of the final product.

Conclusion

The AR CGI process is complex, requiring a combination of advanced software tools, technical expertise, and creative problem-solving. By leveraging the right technology stack, we were able to deliver high-quality CGI players for Star Sports, enhancing the viewer's experience with realistic 3D characters in live broadcasts. Want to explore how you can leverage immersive tech for your business? Get your free one-to-one consultation with us at

About the Author

Pallavi Rakhecha
Marketing Manager