Gen AI Architect

Job description

Programming Languages

• Python

Development Tools

• LangChain, LlamaIndex, LangFlow, Langgraph, LangSmith, Flowise

Techniques

• RAG Techniques

Databases

• Vector Databases (Pinecone, Weaviate, Qdrant)

Additional Technologies

• Knowledge Graphs, FastAPI, Streamlit, Gradio

Languages & Libraries

• Python, Data Engineering, OSS LLMs (Llama2, Mixtral, GPT-Neo, GPT-J)

Tokenization & Frameworks

• Tokenizers (SentencePiece, Hugging Face Tokenizers), Fine-tuning Frameworks (Hugging Face Transformers, PyTorch Lightning)

Datasets

• HuggingFace Datasets, TensorFlow Datasets

Infrastructure & CI/CD

• DevOps, Kubernetes, Docker, Git, Jenkins, GitLab, GitHub Actions

Monitoring & Management

• Ray, SeldonCore, MLFlow, MLServer, Triton, BentoML, Prometheus, Grafana

Data Processing & Management

• Python, Apache Spark, Apache Kafka, AWS S3, Azure Data Lake Storage (ADLS), Delta Lake

Workflow Automation

• Apache Airflow, dbt, Apache NiFi, Fivetran, Airbyte, Great Expectations

Data Catalogs

• Amundsen, Collibra, Alation

Threat Modeling & Security

• AI-Specific Threat Modeling Tools, Secure ML Pipeline Tools, API Security Tools

Monitoring & Prevention

• AI Security Monitoring Tools, Prompt Injection Prevention Libraries, Adversarial Example Detection Libraries

Ethics & Fairness

• AI Ethics Frameworks and Tools, Bias Detection and Mitigation Tools, Fairness Metrics Libraries

Privacy & Security

• Privacy-Preserving Machine Learning Libraries, Robustness and Security Tools ·<span

Qualifications

BACHELOR OF TECHNOLOGY