Application Deadline
June 30, 2026 (Early applications will be given preference)
Job Location
Gulshan-1, Dhaka
Number of Vacancies: 2
Who are we looking for?
We are looking for dynamic individuals who are curious about AI systems and passionate about ensuring quality through structured evaluation, prompt testing, and analysis.
Educational Requirements
- B.Sc. in Computer Science & Engineering / Software Engineering / Data Science or related field.
Experience Requirements
- 0 – 2 years of experience (Fresh graduates are encouraged to apply).
Overview of the Responsibilities
- Evaluate AI-generated outputs (text, chat responses, structured data) to ensure quality, accuracy, and consistency
- Design and execute test scenarios for AI systems, including prompt variations, edge cases, and agent/skill workflows.
- Identify inconsistencies, hallucinations, unsafe assumptions, and unexpected behaviors in AI responses.
- Analyze outputs and compare performance across prompts, models, agents, or configurations.
- Document evaluation results, issues, debugging notes, and improvement recommendations.
- Work closely with engineering, product, and GenAI teams to improve AI system performance.Assist in preparing evaluation datasets, annotations, and benchmarking criteria
- Maintain documentation of evaluation processes and reporting
Key Requirements
- Strong analytical and problem-solving skills
- High attention to detail and structured thinking
- Basic understanding of software testing concepts (test cases, defect tracking)
- Familiarity with AI tools (ChatGPT or similar)
- Familiarity with Generative AI tools such as ChatGPT, GitHub Copilot, Claude Code, Codex, OpenClaw, or similar.
- Basic understanding of prompts, AI agents, skills, and model evaluation concepts.
- Responsible use of AI-generated code or suggestions, with proper review, debugging, testing, and understanding before submission.
- Ability to analyze data and identify patterns or inconsistencies
- Good spoken & written communication skills in English
Nice To Have Requirements
- Basic knowledge of Python or data handling.
- Experience with responsive and adaptive design.
What's in it for you?
- Competitive salary with an excellent career opportunity in a focused & stable organization.
- Most importantly, a friendly work environment with the opportunity to learn from highly skilled mentors.
How would you apply?
If you believe you are the right candidate, then send your CV along with a cover letter to career@relisource.com by June 30, 2026. Please put the code “JAE_30042026” in the email’s subject.
Your Cover Letter must include answers of the following questions:
- What does ReliSource do?
- How does this position align with your career path?
- And what values can you bring to the organization?
Answer to these 3 questions should not exceed a maximum of 150 words each.
IMPORTANT: Emails without “JAE_30042026” in the subject line and Resumes without cover letter & photograph will be automatically discarded.