As a Software Engineer at Agile Market Intelligence, you will take ownership of our market intelligence technology platform, maintaining and enhancing our cloud-based data pipelines, analytics tools, and reporting systems. You will manage the complete technology stack, from BigQuery data warehouse and Cloud Run infrastructure to React frontends and AI-powered report generation, that processes 100,000+ survey responses monthly and delivers insights to financial services clients.
Working independently with the Director, you will be the sole software engineer working alongside a team of data analysts. You will solve complex data engineering challenges, build scalable cloud architecture, and integrate AI capabilities that transform raw survey data into interactive dashboards and automated reports.
This is a unique opportunity for a mid-level engineer ready to own a production platform and shape technical direction in a growing market research firm.
Cloud Infrastructure & DevOps
- Maintain and optimize Google Cloud Platform infrastructure
- Manage deployments, rollbacks, and system updates with 99.5% uptime target
- Monitor system health, performance, and costs across multiple GCP projects
- Handle security compliance and data protection standards
- Implement automated monitoring and alerting systems
Data Engineering & Analytics
- Manage BigQuery data warehouse with multi-dimensional schema
- Write and optimize SQL queries for data transformations and migrations
- Build and maintain ETL pipelines transforming survey data into analytics-ready formats
- Execute monthly data pipeline updates and historical migrations
Full-Stack Application Development
- Maintain Node.js/Express backend APIs with TypeScript
- Develop and enhance React frontend applications (Vite, TypeScript, Radix UI)
- Build interactive data visualizations using Chart.js and Recharts
- Integrate third-party services: Tableau (Connected Apps), ThoughtSpot (REST API)
- Implement authentication and multi-tenant architecture using Supabase
AI Integration & Automation
- Maintain AI-powered chart generation and report automation systems (OpenAI GPT-4, Anthropic Claude)
- Build and maintain Model Context Protocol (MCP) servers for AI assistant integration
- Optimize prompt engineering and batch processing to manage API costs
- Maintain automated content generation for newsletters and research reports
- Minimum 5 years professional software development experience in a full-stack role
- Strong JavaScript/Node.js skills
- Advanced SQL expertise including complex queries, joins, aggregations, and window functions
- Google BigQuery experience with schema design, query optimization, and cost management
- Cloud platform experience (Google Cloud Platform strongly preferred)
- RESTful API design and implementation with Express.js or similar frameworks
- React and modern frontend development
- Git version control with branching, merging, and pull requests
- Strong problem-solving skills for debugging production issues and optimizing performance
- Excellent documentation skills and ability to explain technical concepts clearly
- Experience with Chart.js or similar data visualization libraries
- Familiarity with AI-assisted development tools (Cursor, GitHub Copilot)
- Desirable: Multi-tenant SaaS architecture and authentication systems (JWT, Supabase)
