Backend & AI Engineer

We are looking for an experienced and ambitious Backend & AI Engineer with deep expertise in search systems and data products and analytics to join our team.

Skills & Qualifications

• You have 5+ years of experience in backend engineering, specializing in highly data complex and scalable web scraping, search and data products.
• You have strong expertise in keyword-based search systems like Lucene or Elasticsearch, mongodb, and other vector databases.
• You have hands-on experience building semantic vector-based search systems, leveraging libraries like FAISS, Milvus, Pinecone, Langchain etc..
• You have experience implementing Retrieval-Augmented Generation (RAG) frameworks with AI search systems.
• You are highly proficient in Python, and have solid experience implementing production grade globally scalable products in python,
• You have experience working with large-scale data pipelines, integrating and transforming data for search indexes.
• You have a strong understanding of natural language processing (NLP) models and embeddings (e.g., OpenAI embeddings, Hugging Face models).
• You have experience with scalable database systems: SQL and NoSQL (PostgreSQL, MongoDB, or similar).
• You are familiar with cloud platforms (AWS, GCP, or Azure) for deploying scalable backend infrastructure.
• You have experience building and managing APIs (REST, GraphQL) that power search-based applications.
• You have a solid understanding of distributed systems, caching, and high-performance architectures.
• You have worked on production-ready monitoring tools and analytics frameworks for backend systems.
• Experience integrating AI/ML models into production systems is a significant advantage.
• Experience with vector search databases like Pinecone, Vespa, or Weaviate is a big advantage.

Preferred Soft Skills

• You are a self-driven problem-solver with excellent organizational and time-management skills.
• You are confident, capable of working independently while aligning with broader team goals.
• You are a team player and contribute to a collaborative, innovative engineering culture.
• You have strong communication skills to articulate complex technical topics clearly to both technical and non-technical stakeholders.
• You have an appetite for learning and staying updated with cutting-edge technologies in AI, search systems, and backend engineering.

Responsibilities / What You Will Do

• Design, research, implement and maintain search systems and products utilizing AI at their core.
• Engineer and optimize RAG-based AI search and chat systems into Dcentralab products, especially web3index.com .
• Develop and maintain backend systems that handle large-scale scraping, search indexing and querying pipelines.
• Implement APIs that serve search results with high availability and low latency.
• Collaborate with data scientists to train, integrate, and serve machine learning models for search-based applications.
• Build and manage data pipelines for ingesting, transforming, and indexing structured and unstructured data.
• Optimize backend systems for performance, scalability, and cost efficiency.
• Set up and monitor infrastructure for data products, ensuring robustness and reliability.
• Work closely with frontend and product teams to align backend capabilities with end-user requirements.
• Stay up-to-date with advancements in search technologies, NLP models, AI Agent engineering and agent orchestration engineering, vector-based search libraries, RAG architectures, implementing the best solutions for our needs.

About DcentraLab

Since 2017, DcentraLab has been a pioneering force in Web3 and blockchain development. Expanding beyond its initial product, 2Key, DcentraLab has introduced innovative solutions such as Hord, ChainPort, TokensFarm, and DcentraLab Diligence, with a commitment to ongoing growth. Through a relentless pursuit of cutting-edge technologies, DcentraLab remains at the forefront, shaping the future of decentralized ecosystems and blockchain-based products.