ARCHCONF'26
REGISTER →

AI-Enhanced Big Data: Integrating Private LLMs and Vector Databases

In this dynamic talk, we explore the fusion of AI, particularly ChatGPT, with data-intensive architectures. The discussion covers the enhancement of big data processing and storage, the integration of AI in distributed data systems like Hadoop and Spark, and the impact of AI on data privacy and security. Emphasizing AI's role in optimizing big data pipelines, the talk includes real-world case studies, culminating in a forward-looking Q&A session on the future of AI in big data.

This talk delves into the innovative integration of advanced AI models like ChatGPT into data-intensive architectures. It begins with an introduction to the significance of big data in modern business and the role of AI in scaling data solutions. The talk then discusses the challenges and strategies in architecting big data processing and storage systems, highlighting how AI models can enhance data processing efficiency.

A significant portion of the talk is dedicated to exploring distributed data systems and frameworks, such as Apache Hadoop and Spark, and how ChatGPT can be utilized within these frameworks for improved parallel data processing and analysis. The discussion also covers the critical aspects of data privacy and security in big data architectures, especially considering the implications of integrating AI technologies like ChatGPT.
The talk further delves into best practices for managing and optimizing big data pipelines, emphasizing the role of AI in automating data workflow, managing data lineage, and optimizing data partitioning techniques. Real-world case studies are presented to illustrate the successful implementation of AI-enhanced data-intensive architectures in various industries.

  1. Introduction (10 mins)

    • Unleashing the power of big data in modern businesses
    • Importance of data-intensive architectures in scaling data solutions
    • Introducing AI's role in big data, with a focus on ChatGPT

  2. Part 1: Architecting for Big Data Processing and Storage (25 mins)

    • Understanding the challenges of big data processing
    • Designing scalable data storage solutions
    • Achieving high availability and fault tolerance
    • Integrating AI models like ChatGPT for enhanced data processing

  3. Part 2: Distributed Data Systems and Frameworks (25 mins)

    • Leveraging the potential of distributed processing tools
    • Introduction to Apache Hadoop, Spark, and other frameworks
    • Performing parallel data processing and analysis
    • How ChatGPT and similar AI models can be utilized in distributed systems

  4. Part 3: Handling Data Privacy and Security in Big Data Architectures (20 mins)

    • Challenges and considerations for data privacy in big data environments
    • Ensuring data security and confidentiality
    • Adhering to compliance regulations in big data projects
    • Discussing the implications of AI like ChatGPT on data privacy and security

  5. Part 4: Best Practices for Managing and Optimizing Big Data Pipelines (20 mins)

    • Data workflow orchestration and automation
    • Data lineage and metadata management
    • Data partitioning and optimization techniques
    • Utilizing AI models like ChatGPT for optimizing big data pipelines

  6. Case Studies and Real-World Applications (10 mins)

    • Inspiring examples of successful data-intensive architecture implementations
    • Learning from the experiences of leading organizations
    • Case studies involving ChatGPT in big data solutions

  7. Conclusion and Q&A (10 mins)

    • Recapitulation of key takeaways
    • Addressing questions and facilitating discussions with the audience
    • Highlighting the future of AI and big data with technologies like ChatGPT

Overall, this talk aims to provide a comprehensive understanding of how AI, especially ChatGPT, can be integrated into data-intensive architectures to enhance big data processing, analysis, and management, preparing attendees to harness AI's potential in their big data endeavors.

Key Takeaways:

  1. AI's Impact on Big Data: Insight into how AI, especially ChatGPT, enhances big data processing and scalability.
  2. Designing AI-Integrated Systems: Strategies for building scalable, AI-enabled data processing and storage solutions.
  3. AI in Distributed Frameworks: Understanding the integration of AI in systems like Hadoop and Spark for improved data analysis.
  4. Data Privacy and Security: Best practices for maintaining data integrity and compliance in AI-enhanced big data environments.
  5. Optimizing Data Pipelines with AI: Techniques for using AI to automate data workflows and optimize data management.
  6. Real-World AI Applications: Learning from case studies where AI in data architectures has driven success.
  7. Future of AI in Big Data: Insights into the evolving role and potential of AI technologies like ChatGPT in big data.
  8. Interactive Learning: Engaging in discussions and Q&A for a deeper understanding of AI's role in big data.

Rohit Bhardwaj

About Rohit Bhardwaj

Rohit Bhardwaj is a Director of AI & Data Architecture at Salesforce, where he focuses on enterprise AI, agentic systems, cloud-native architecture, distributed systems, data platforms, security, and large-scale transformation.

Over his career, Rohit has designed and led complex enterprise platforms across AWS, Google Cloud, microservices, real-time data, API ecosystems, resilient distributed systems, and AI-enabled architectures. His work increasingly focuses on the challenges enterprises face as software evolves from deterministic services to AI-native and agentic systems—particularly around reliability, governance, evidence, security, observability, cost, and safe autonomy.

Rohit is the author of System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems, published by Apress. The book presents a modern approach to system design covering scalability, distributed systems, AI architecture primitives, security, reliability, economics, agentic systems, and real-world architectures including e-commerce, ride sharing, payments, fraud detection, messaging, video streaming, file storage, and search. (Springer Link)

Book:
Amazon: https://a.co/d/09Zs1twa
Publisher / Springer Nature: https://link.springer.com/book/10.1007/979-8-8688-2782-2
O'Reilly: https://learning.oreilly.com/library/view/system-design-with/9798868827822/ 

Rohit is also an O’Reilly instructor and a frequent speaker at technology conferences including No Fluff Just Stuff, UberConf, GIDS, and other international events. His talks focus on practical architecture lessons from building and operating complex systems, including AI control planes, trusted agents, inference at scale, evidence-first RAG, AI security, distributed-system failure, and AI-era software architecture.

As a trusted advisor and architecture leader, Rohit works at the intersection of business strategy and deep technical architecture—helping teams translate complex business problems into scalable, resilient, secure, and economically sustainable systems.

Rohit holds an MBA in Corporate Entrepreneurship from Babson College and graduate-level education in Computer Science from Boston University and Harvard University.

Connect with Rohit:
LinkedIn: http://linkedin.com/in/rohit-bhardwaj-cloud
X / Twitter: @rbhardwaj1

More About Rohit »

© 2026 No Fluff, Just Stuff TM All rights reserved.