Home / Buzzfeed / Article / From Batch Windows to Streaming Tables: A Career Spent Rebuilding the Plumbing of Enterprise Data

From Batch Windows to Streaming Tables: A Career Spent Rebuilding the Plumbing of Enterprise Data

Naveen Bagam’s 18+ year journey across data engineering, banking, healthcare, retail and enterprise technology.

Naveen Bagam.

Naveen Bagam.

The people who keep large institutions running rarely appear in the coverage of the technologies they use. A bank that settles a card transaction the moment it is presented, a pharmacy chain that knows whether a drug sits on a shelf in one of more than eight thousand pharmacies, a travel company that can produce years of tax records for a jurisdiction on request: each of those capabilities rests on data pipelines that somebody designed, tuned, and then nursed through the nights when they broke. Naveen Bagam has spent more than eighteen years doing that work, and the arc of his career tracks almost exactly the shift that reorganized the discipline around him.

He began in 2006 in Chennai, writing Pro*C and PL/SQL for Target's distribution system, where the questions were about scheduling merchandise into warehouses and shipping it out to stores. The tools of that era were unforgiving. Performance problems were diagnosed with EXPLAIN PLAN and TKPROF, and a poorly written cursor could stall a nightly batch long enough to matter by morning. Bagam moved from there to Citibank's International Personal Banking division, where he worked on ORBIT, an online real-time banking platform serving customers in London, Jersey, and Switzerland across more than ten modules covering account openings, funds transfers, deposits, mutual funds, and brokerage. The end-of-day process on that system was batch accounting in its classical form: accruals calculated on customer and branch accounts, a handoff file generated, ledgers updated downstream, reports produced for internal audit.

Other Articles

Mid-Day FastView All