[Intra Rede] Preparação para a transmissão da Copa do Mundo: Eficiência, Escala e Confiabilidade

Welcome to the Live Session on Internet Infrastructure

Introduction to the Event

• The live session focuses on discussing internet infrastructure in the current context, specifically preparing for World Cup broadcasts.

• Various speakers are invited to share insights on improving networks for upcoming World Cup transmissions.

Announcements and Participation

• Participants interested in receiving a certificate of participation must register via a provided link or QR code.

• A giveaway is announced, featuring a "Kit Nick" that includes various items related to digital citizenship and programming.

Digital Citizenship Video Presentation

Importance of Digital Citizenship

• Companies are encouraged to support digital citizenship initiatives by downloading and sharing promotional videos with their logos.

Engaging with the Audience

Interaction Encouragement

• Viewers are reminded of the importance of staying engaged throughout the live session, referencing past experiences where leaving early led to issues during games.

Overview of Panelists and Topics

Introducing Key Speakers

• Notable panelists include representatives from Nickbr, XBR, Open CDN, and external experts specializing in network measurements.

Focus Areas for Discussion

• Discussions will cover network assessment techniques necessary for handling increased traffic during major events like the World Cup.

Format of Interaction During the Live Session

Q&A Structure

• Audience questions can be submitted via chat; responses will be addressed at the end of each presentation segment.

Technical Check and Audience Engagement

Ensuring Quality Experience

• Viewers confirm audio and video quality before proceeding. They are also asked about their locations to gauge audience reach.

Promoting Wider Participation

Sharing Links

• Participants are encouraged to share links with colleagues or friends who may benefit from attending or watching later.

Building Community Support

Call for Likes and Subscriptions

• The host emphasizes liking the video and subscribing to enhance visibility and reach more viewers interested in technical content related to internet governance.

Transitioning to Expert Insights

Introduction of Rafael Ganacim

• Rafael Ganacim begins his presentation focusing on preparations needed for broadcasting during significant events like the World Cup.

Preparing Networks for Major Events

Challenges Ahead

• The upcoming World Cup presents unprecedented challenges due to an increase in participating teams (48), leading to 104 matches over 39 days.

Anticipated Traffic Surge

• Expectation of continuous high traffic over 27 consecutive days as networks handle streaming demands from multiple platforms simultaneously.

Broadcasting Platforms Overview

• Major broadcasters include CASE TV (YouTube & Disney Plus), Globo (Sport TV & GE TV), SBT Sports, all contributing significantly through various streaming services.

CDN Utilization Strategies

• Disney Plus will leverage its own data centers alongside Akamai's CDN primarily for live streams while having AWS as backup if needed.

Network Behavior During Sporting Events

Analyzing Past Events' Impact on Traffic

• Historical data shows spikes in network traffic during key moments such as team announcements or match broadcasts; notable increases were observed up to 500% during peak times.

Streaming vs Social Media Traffic Patterns

• Two distinct waves were identified: one driven by streaming demand peaking during matches, while social media engagement surged immediately after key events like player announcements or goals scored.

Preparations for Major Streaming Events

Overview of Network Traffic and Upgrades

• The volume of network traffic during major events can be significantly larger than usual, necessitating upgrades and documentation of lessons learned.

• Upcoming global events like the Olympics and future World Cups will further increase streaming demands, emphasizing the need for preparation.

• The largest streaming event in history is imminent, highlighting the importance of maintaining a stable live stream amidst potential issues.

Changes in Network Monitoring

• As user patterns change with significant events, monitoring strategies must adapt to accommodate unpredictable spikes in traffic.

• If Brazil progresses through tournament phases, peak usage may increase dramatically, requiring robust infrastructure.

Globo's CDN Strategy

Challenges Faced by Globo

• Globo faces unprecedented challenges due to rapidly increasing viewership numbers that were not anticipated in previous years.

• A swift expansion of capacity has been necessary over the last two years to prepare for high-demand events like the World Cup.

Content Delivery Network (CDN)

• Globo’s CDN is designed specifically for Brazilian audiences, ensuring low latency and high-quality content delivery across various regions.

• The CDN has established presence in all capitals with extensive connectivity to ensure millions of users can access content seamlessly.

User Engagement Metrics

Peak Usage Statistics

• During major events, Globo experiences peaks exceeding 3.4 million simultaneous users and traffic rates surpassing 16 TB per second.

• Goals include minimizing join times below five seconds and buffer rates under 0.5% to enhance viewer experience.

Year-Round Challenges

• Besides the World Cup, other significant events throughout the year also strain resources; examples include popular shows like BBB and Rock in Rio.

Connection Strategies with Globo

Recommendations for Operators

• Operators are encouraged to connect via multiple localities using PNI (Private Network Interconnect), maximizing their connection capabilities with Globo’s infrastructure.

Addressing Copa Challenges

• This World Cup presents unique challenges due to higher simultaneous user engagement compared to regular broadcasts or league games.

Reducing Latency

Technological Innovations

• Efforts are underway to reduce latency between streaming services and traditional TV broadcasts through advanced technologies aimed at achieving low-latency transmission.

Increased Bit Rate Demand

• With more users consuming higher bit rates during live streams—20% to 40% greater than typical programming—network resources must be managed effectively.

Infrastructure Enhancements

Capacity Growth Initiatives

• Over two years leading up to the World Cup, Globo increased server capacity by 50%–75%, enhancing overall service delivery capabilities across Brazil.

Regional Investments

• Significant investments have been made across various regions including Porto Alegre and Curitiba to bolster local capacities without relying solely on São Paulo connections.

Geolocation Considerations

Importance of Accurate Geolocation

• Ensuring accurate geolocation data is crucial for effective content delivery; incorrect data can lead users away from optimal points of access.

Recommendations for ISPs

• ISPs should review their prefix announcements regularly to ensure they align with regional delivery goals while optimizing BGP configurations accordingly.

Frequently Asked Questions about Connecting with Globo

Connection Prioritization Techniques

• To prioritize connections via specific IX points over others, operators should manipulate SPF settings before sending requests.

Troubleshooting Location Issues

• For misidentified prefixes or location issues, operators should contact Maxmind directly rather than going through Globo for corrections.

Overview of Camai's Piring and Infrastructure

Introduction to Piring

• Camai offers bilateral piring through the email piring@camai.com, facilitating connections with various sessions.

• The company is focused on expanding connectivity in cities that have not yet reached their capacity needs.

Traffic Capacity and Infrastructure

• Camai's traffic delivery within Brazil exceeds 99%, with additional capacity available outside the country.

• The platform can handle peak traffic significantly above normal levels, having recorded 14.6 terabits recently while being prepared for over 25 terabits.

Technical Specifications of Traffic Management

Server Capacity and Peering Policies

• São Paulo has a significant server capacity, allowing for both public and private peering arrangements.

• A limit of 30 GB for private peering is set due to engineering constraints; exceeding this would require impractical infrastructure.

Data Accessibility

• Users can access data for piring through Piring DB at pindb/net/2, ensuring transparency in operations.

Preparation for Major Events

World Cup Readiness

• Camai has been preparing its infrastructure ahead of the World Cup rather than making last-minute adjustments.

• The company prioritizes regional traffic delivery to enhance user experience by serving content from local nodes instead of major hubs like São Paulo or Rio de Janeiro.

Dedicated Caches and Content Delivery

Cache Infrastructure

• Over the past decade, dedicated caches have been installed across major ISPs, totaling around 15 terabits of dedicated capacity.

• Smaller installations are no longer feasible due to the high volume of users; larger setups (500–800 GB capacities) are preferred.

Understanding Camai's Operational Model

DNS-Based Traffic Distribution

• Camai operates using a DNS-based system that optimally directs traffic based on latency and internal capacity metrics.

User Experience Dynamics

• When users make requests, their queries reach Camai’s name servers which determine optimal IP addresses based on real-time conditions.

Peering Dynamics and Network Performance

Regionalization Challenges

• If users are closer to one node but receive content from another location (e.g., São Paulo), it may lead to performance issues; monitoring tools can help identify these discrepancies.

Network Connectivity Insights

• Dedicated nodes operate independently but connect through Bakibon networks, crucial for maintaining performance during high-demand periods.

Event Handling Strategies

Traffic Steering Techniques

• Modifications such as path prepending are not utilized; instead, a mapping system identifies optimal IP addresses locally based on current network conditions.

Final Thoughts on Network Operations

Collaboration with ISPs

• Effective collaboration involves sending all routing prefixes to ensure optimal delivery paths during events like the World Cup.

Transitioning Between Presenters

Introduction of New Speaker

• Júlio Cirota takes over after Eric’s presentation, indicating continuity in discussing network preparations related to upcoming events.

Local Traffic Exchange and Open CDN Initiative

Overview of Local Traffic Exchange

• The traffic will be exchanged locally within the PTT, reducing the need for long-distance data transfer and lessening dependency on major ISPs in São Paulo, Rio de Janeiro, and Fortaleza.

Open CDN Project Details

• The Open CDN is a non-profit initiative where Nickber covers equipment installation costs. Operational costs are shared among participating members.

Infrastructure Locations

• Currently, Open CDN operates in nine locations: six with complete infrastructure (Salvador, Manaus, Brasília, Recife, Belo Horizonte, Belém) and three extensions (Feira de Santana, Caruaru, Goiânia).

Cost Structure and Incentives

Cost Sharing Model

• Maintenance costs for infrastructure are divided among participants. A pricing table outlines costs in various locations like Brasília and Salvador.

Traffic Exemption Policy

• There is a traffic exemption for usage between 100 MB to 1 GB; only traffic exceeding 1 GB incurs charges.

Participation Process for ISPs

Joining the Open CDN

• ISPs establish a bilateral BGP session with Open CDN and select a virtual port size representing their intended traffic exchange capacity.

IPv6 Traffic Management

IPv6 Incentives

• All IPv6 traffic is exempt from charges except in specific localities where control over consumption is necessary due to bandwidth management needs.

Partnerships Impacting Costs

Local Partnerships Benefits

• Some locations have partnerships that provide free data center space or transport links. This allows zero-cost traffic delivery in those areas.

Advantages of Joining Open CDN

Benefits for Providers

• Participants experience reduced transportation costs and improved internet stability for clients. CDNs gain immediate access to numerous providers regionally.

Recent Achievements of Open CDN

Milestone Achievement

• The project recently surpassed 1 Terabit of aggregated traffic across all locations, highlighting its growing significance in the internet ecosystem.

Preparing for Major Events

Identified Challenges

• Three main challenges were identified: link capacity for cache feeding, connection links to local IXBR points, and content delivery capabilities of CDNs during events like the World Cup.

Cache Feeding Links

Link Capacity Analysis

• All localities feed caches through transport links arriving at IXBR São Paulo; however, Manaus faces challenges securing quality transport links.

(t=6508s] Cache Consumption Efficiency

• [](t=6508s] Feeding caches requires relatively low bandwidth compared to overall delivery volume during live events. Most localities already have redundant links established.

Redundancy Status

• While most sites have redundancy measures in place , some areas like Belém are still finalizing these upgrades due to fiber deployment delays .

Interconnection Capacity

• All localities possess interconnection capacities that can handle two to three times peak traffic levels expected during World Cup matches .

Historical Data Insights

• Previous World Cup data indicates that certain CDNs see significant shifts in streaming behavior during live events , impacting overall network performance .

Monitoring Delivery Capabilities

• Continuous monitoring ensures that when CDNs approach capacity limits , proactive communication occurs to facilitate necessary expansions before critical events .

Preparedness Assurance

• Comprehensive mapping has been conducted regarding required expansions ensuring smooth event execution without significant issues anticipated .

Closing Remarks & Future Engagement

• Acknowledgment of partners supporting the initiative; invitation extended to potential new partners interested in joining or providing resources .

Discussing the Importance of IPv6 for Streaming During Major Events

Overview of Network Capacity and Traffic Management

• The discussion begins with concerns about user engagement and network overload during peak traffic times, particularly at the start of events like a game.

• Emphasis is placed on the necessity of implementing IPv6 to handle increased traffic effectively, especially for CDNs (Content Delivery Networks).

Insights on IPv6 Implementation

• Claudinei mentions that whether or not CGENAT (Carrier Grade NAT) is in place affects content delivery; if properly dimensioned, IPv4 can suffice.

• However, if there are bottlenecks in equipment like CGENAT, transitioning to IPv6 could provide a competitive edge.

Dual Stack Approach and CDN Support

• Eric highlights that using a dual stack approach with both IPv4 and IPv6 allows for native delivery of content via IPv6 when available.

• A comparison between Fortaleza and São Paulo shows significant differences in IPv6 adoption rates among users.

User Behavior and Provider Differences

• The disparity in user behavior between regions indicates varying levels of provider support for IPv6 implementation.

Essential Nature of IPv6 for Modern Internet Use

• Rodrigo asserts that adopting IPv6 is crucial for all internet content today, especially as major events approach. He warns that reliance on CGENAT may introduce delays affecting user experience.

Addressing Live Transmission Delays

Factors Contributing to Delay in Live Broadcasts

• Claudinei explains that most delays stem from video encoding rather than CDN platforms or network issues.

• He notes that while network latency exists, it typically remains within milliseconds unless processing delays occur due to high loads on CGENAT.

Mitigating Delay Issues

• Recommendations include reducing cache times at the CDN level to minimize delay impacts during live broadcasts.

Geolocation Accuracy in Content Delivery

Importance of Accurate Geolocation Data

• Eric discusses how geolocation data directly influences latency tests and content delivery efficiency through DNS configurations.

Dynamic vs. Static Geolocation Solutions

• Camai utilizes an internal algorithm for geolocation but recommends dynamic geofeeds over static solutions due to their reliability.

Enhancing Geolocation Through Registries

Utilizing GFED for Improved Location Data

• Rodrigo emphasizes the importance of accurate registration with Maxmind and GFED to ensure proper geolocation mapping.

Collaboration Between Providers

• The ability to link updated geolocation data through registries helps improve overall service quality across networks.

Final Thoughts on Network Preparedness

Key Takeaways from Panelists

• Rafael stresses visibility into network operations during peak times and suggests strategic maintenance before major events.

• Claudinei advises reviewing announcements related to routing paths while ensuring resilience against potential outages.

• Eric encourages checking bilateral connections regularly while maintaining close communication regarding regionalization issues.

Conclusion: Preparing for Upcoming Events

• Each panelist reiterates the importance of readiness ahead of significant events like the World Cup, emphasizing proactive measures to enhance performance.