N #2945
Applications open
Full-Time Job
AI Evaluator - Typescript (Freelance Opportunity)
Biz Tech Consultants
About the role
We are looking for experienced software engineers to work on a freelance basis on RLHF projects that support the training and evaluation of AI coding agents. Depending on the project, the work can involve designing realistic technical tasks, or reviewing and rating AI generated responses for correctness, clarity, and reliability. It suits engineers who enjoy precise technical writing and careful quality review as much as building.
Key Responsibilities
- Design technical tasks across areas such as software development, debugging, data processing, security, and machine learning, and set up any supporting environment and automated tests needed to validate them, where the project calls for task authoring.
- Review AI generated responses to technical tasks, assessing correctness, code quality, and adherence to instructions.
- Provide clear, evidence based written feedback and comparative ratings across responses.
- Validate task or evaluation difficulty against AI model outputs and revise based on review feedback.
- Desired Candidate Profile Highly Required 4 to 7 years of experience building production systems, not just internal tools.
- Strong hands on skill in Typescript, Javascript Comfortable with Docker.
- Comfortable working with one relational and one NoSQL database.
- Can point to a clear before and after metric from past work.
- Experience working with remote or international clients or teams.
- Some exposure to secure data handling or compliance work.
- Preferred Has integrated an AI or LLM API into a real, shipped feature.
- Experience in AI training and evaluation work.
- Employment Type Contractual/
Freelance
Key Skills
- Python, Java, JavaScript, Docker, AI Integration, Typescript Evaluation Process After you apply through Naukri , we will share an Information Form with you.
- Once you submit the completed form, our team will review the information provided.
- Shortlisted candidates will receive interview slots for the next stage of the evaluation process.
- Further details regarding the selection process and subsequent steps will be discussed over a call once you are shortlisted.
Eligibility & process
Who can apply
Experience: 3-7 Yrs. Open to matching qualifications.
Skills & stack
Selection process
- Online Assessment / Technical Interview Rounds / HR Review
Prep kit
19 resourcesStudy material 4
Aptitude Practice Questions & Mock Tests
Curated logical, quantitative, and verbal reasoning problems for the initial online screening round.
Company-Specific Interview Preparation Corner
Detailed interview experiences, exam formats, and previous test questions for Biz Tech Consultants and tech roles.
Technical Placement Question Bank
High-yield coding cheat sheets, core CS fundamentals (OOP, DBMS, OS, Networks), and rapid revision guides.
Algorithm, DSA & Live Code Debugger Practice
Hands-on problem sets to improve coding speed and step-by-step memory debugging.
Company-specific guides 4
APTITUDE & LOGIC
Aptitude Practice Questions & Online Mock Tests
Curated logical, quantitative, and verbal reasoning problems to sharpen reasoning skills required for the initial screening test.
COMPANY GUIDE
Biz Tech Consultants Interview Preparation Corner
Comprehensive guide covering typical interview formats, common questions, and preparation tips for Biz Tech Consultants and off-campus tech roles.
MOCK TESTS & PAPERS
Comprehensive Interview Prep Resources & Syllabus
Collection of previous year questions, company-specific test patterns, and interview experiences for technical and HR rounds.
CODING PRACTICE
Algorithm and Data Structure Problem Set
Practice problems to improve coding proficiency and algorithm problem-solving speed for technical rounds.
Likely coding questions 4
Round-wise strategy 4
Round 1: Online Assessment (OA)
Aptitude, Quantitative Logic & 2 Coding Problems
Focus on accuracy and speed. Practice arrays, strings, and standard arithmetic puzzles.
Round 2: Technical Interview 1
Core Tech Stack (Artificial Intelligence, TypeScript, Freelancing, JavaScript, Evaluation, Python, Java, Next.js) & Live Code Tracing
Explain your thought process aloud. Analyze time & space complexities before coding.
Round 3: System Design & Problem Solving
Database Schemas, APIs & Architecture Basics
Clarify edge cases, diagram schemas cleanly, and discuss scalability trade-offs.
Round 4: HR & Cultural Fit Discussion
Biz Tech Consultants Core Values, Learning Agility & Offer Terms
Demonstrate passion, strong communication, and readiness for full-time collaboration.
Technical questions 4
What is the bias-variance tradeoff and how do you prevent overfitting? Answer
Model answer: High bias leads to underfitting (oversimplified model), high variance leads to overfitting (captures noise). Mitigate using L1/L2 Regularization, Dropout, Cross-Validation, and data augmentation.
Explain the difference between Precision, Recall, and F1-Score. Answer
Model answer: Precision = TP / (TP + FP) (correctness of positive predictions). Recall = TP / (TP + FN) (coverage of actual positives). F1-Score is the harmonic mean of Precision and Recall.
How does Gradient Descent work and what is the role of Learning Rate? Answer
Model answer: It optimizes loss functions by iteratively moving weights in the direction of negative gradient. A large learning rate may overshoot the minimum; a small rate causes slow convergence.
What is the difference between Supervised, Unsupervised, and Self-Supervised learning? Answer
Model answer: Supervised uses labeled data (X -> y). Unsupervised finds hidden patterns in unlabeled data (clustering/PCA). Self-supervised generates labels from input data (e.g. masked language modeling in BERT/Transformers).
Behavioural & HR questions 3
Why do you want to join Biz Tech Consultants as a AI Evaluator - Typescript (Freelance Opportunity)?
Highlight Biz Tech Consultants's market reputation, recent tech innovations, and how your skills in Artificial Intelligence directly solve their team's objectives.
Highlight Biz Tech Consultants's market reputation, recent tech innovations, and how your skills in Artificial Intelligence directly solve their team's objectives.
Describe a challenging bug or academic project roadblock and how you resolved it.
Use the STAR method: Situation (project context), Task (what needed solving), Action (specific tools/logic applied), Result (quantifiable positive outcome).
Use the STAR method: Situation (project context), Task (what needed solving), Action (specific tools/logic applied), Result (quantifiable positive outcome).
How do you handle strict deadlines or sudden scope changes?
Explain your prioritization strategy, proactive communication with mentors/peers, and agile mindset.
Explain your prioritization strategy, proactive communication with mentors/peers, and agile mindset.
Competitive Package (Best in Industry)
Remote, India
Experience: 3-7 Yrs. Open to matching qua…
