Position: Generative AI Specialist
Experience: 6+ years in AI/ML with a focus on Generative AI
Work Mode: Remote
Contract Duration: 6 Months +
Must Have: GPT APIs, LangChain, and fine-tuning of LLMs.
Background:
The client’s platform uses Generative AI models to summarize and derive insights from vast datasets. While the team has built a strong foundation, they require an expert in LLMs and dynamic prompting to create scalable, intelligent solutions and drive AI innovation.
Key Responsibilities:
1. Dynamic Prompt Management o Design frameworks for handling dynamic and use-case-specific prompts.
o Enhance the efficiency and reliability of AI-driven summarization workflows.
2. Fine-tuning and Customization o Fine-tune GPT and other LLMs to align with client-specific needs.
o Implement advanced RAG methodologies for improved response accuracy.
3. Embedding and Retrieval Optimization o Develop and optimize vectorization techniques using cosine similarity, dot product, and other measures.
o Design scalable indexing and retrieval pipelines for large datasets.
4. Git and Collaboration o Use Git for effective version control and model development tracking.
o Conduct regular reviews of AI pipelines and ensure efficient debugging practices.
5. Integration and Insights o Collaborate with the Python team to integrate LLMs seamlessly into the data pipeline.
o Generate actionable insights from the summarized data to aid decision-making.
Required Skills:
• Strong knowledge of GPT APIs, LangChain, and fine-tuning of LLMs.
• Proficiency in vectorization, indexing, and retrieval methods.
• Experience with Azure OpenAI, Google AI, or similar platforms.
• Debugging skills for AI pipelines and related systems.
• Git proficiency for version control in AI/ML projects. Preferred Skills:
• Knowledge of Airflow and agent-based LLM chains.
• Understanding of front-end integrations for AI-driven visualizations.
