Senior NLP Engineer for AI Feature Prototype

TechFlow Inc

Contract · Remote · Flexible hours

About the role

TechFlow Inc is revamping the performance and reliability of its customer‑facing services. As an NLP Engineer you will lead the redesign of the conversational layer for the new PulseCache module, ensuring low latency and high availability under heavy traffic.

Key responsibilities

• Audit and refactor existing NLP pipelines in Python, targeting sub‑second response times.
• Implement streaming inference using TensorFlow Serving and FastAPI for real‑time intent detection.
• Design and integrate a robust fallback mechanism with Redis cache to handle service spikes.
• Set up automated load testing with Locust and monitor metrics via Prometheus/Grafana.
• Collaborate with front‑end engineers to expose REST API endpoints that deliver intent and entity results.
• Document performance benchmarks and deliver a final report by project week 8.

Must-have skills

• 5+ years building NLP pipelines in Python.
• Deep familiarity with transformer models and tokenization.
• Experience deploying models with TensorFlow Serving or TorchServe.
• Proficiency in building RESTful APIs using FastAPI or Flask.
• Strong debugging skills in high‑throughput environments.

Nice to have

• Knowledge of Kubernetes for scaling inference services.
• Background in A/B testing of conversational features.