▶ Watch ↗AI Engineer World's Fair 202615:03
Conference affiliation: Oxylabs · 2026
Giedrius Šteimantas led scraping engineering at Oxylabs at World’s Fair 2026, overseeing scraper API teams and infrastructure for gathering public web data. His work applies the practical lessons of web scraping to AI agents: retrieve usable information, detect failed access before asking a model to interpret it, and choose tools that fit each stage of a task. His reconstruction of a shopping agent explains how those choices affect cost, product selection, and the ability to complete a purchase.
Šteimantas’s use of web data predates his work on agents. His 2014 master’s thesis at Copenhagen Business School examined subscription streaming and film-release strategies, using scraped web information and downloadable IMDb data. It applied data collection to understanding how a new digital distribution channel affected an established industry.
His Tauragė ambassador biography describes entrepreneurship and investment in information technology and wood processing, work with corporations and smaller startups, and a return to Vilnius after eleven years in Denmark. As an honorary ambassador, he helped connect his home region with international partners.
At Oxylabs, Šteimantas was identified as an engineering manager in the company’s 2025 OxyCon coverage and as director of scraping engineering in its September 2026 program. Its World’s Fair 2026 article describes his engineering responsibilities across Scraping API, Web Unblocker, Headless Browser, and Fast Search API, supporting AI retrieval, agent workflows, and training-data collection. These responsibilities connect web-access infrastructure with a recurring application problem: an agent cannot make a useful decision from a page it failed to retrieve.
In The Missing Layer in Agentic AI, Šteimantas describes helping a friend whose chatbot recommended clothing and passed shopping requests to an agent. His friend built the original system; Šteimantas advised on and reworked its web-access stages. The original agent used browser automation to search a fixed set of retailers, inspect products, and make purchases. CAPTCHA challenges interrupted access, heavy pages slowed retrieval, and retries made transaction costs difficult to predict. Location-dependent stock and sizing could also make a product appear available during discovery but unavailable at checkout.
Šteimantas also argues that affordable access to public web data matters for competition. In his discussion of data gatekeeping, he connects restrictions on collection with consequences for investigative journalism, academic research, price comparison, and smaller companies building AI applications. He describes a reciprocal relationship: agents need fresh external information, while AI-assisted collection can reduce the engineering effort required to obtain it. This position gives his emphasis on cost a wider purpose. Avoiding blocked-page processing and unnecessary browser work can make web-dependent applications more practical for teams with limited resources.
▶ Watch ↗AI Engineer World's Fair 202615:03
Loading more talks and highlights…