Machine Learning Expert
Handshake • Remote
Education
PhD
Type
Hourly
Pay
$75/hr
The rate in the listing.
Last checked
14d ago
Checked
Only apply if this role fits your skills and interests.
Role overview
As a Machine Learning Expert, you give feedback on AI answers so the model learns context and intent, using what you know about Data Science.
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- PhD's degree or equivalent professional experience
- Demonstrated expertise in Data Science
- Current university student or recent graduate with .edu email
Machine Learning Engineer interview prep
Questions Machine Learning Engineer interviewers often ask. They aren't taken from this listing.
How do you choose between a simpler interpretable model and a more complex model that performs marginally better?
The decision depends on how the model's output is used downstream. If a human needs to act on and justify individual predictions, like in lending or healthcare, interpretability often outweighs a small accuracy gain. If the model feeds an automated system where explainability isn't a hard requirement, I'll take the complexity if the performance gain is meaningful and validated, not just noise.
Explain how you would set up a proper train, validation, and test split for a time series problem.
Random splitting leaks future information into training for time series, so I split chronologically instead, training on the earliest period, validating on the next, and testing on the most recent. Any cross-validation also needs to respect time order, using something like rolling-origin validation, rather than standard k-fold, which would otherwise let the model see the future during validation.
What statistical test would you use to determine if an A/B test result is significant, and what assumptions does it rely on?
For a conversion-rate comparison, a two-proportion z-test or chi-squared test is standard, and it assumes independent observations and a large enough sample size for the normal approximation to hold. If the sample is small or the metric isn't binary, I'd switch to a more appropriate test, since applying the wrong test's assumptions is a common source of false confidence in A/B results.
How do you approach hyperparameter tuning efficiently when the model is expensive to train?
I use a coarse random search first to identify the promising region of the hyperparameter space, since grid search wastes compute on combinations unlikely to matter. From there, Bayesian optimization narrows in on the best configuration with far fewer expensive training runs than an exhaustive search would require, which matters a lot when each run is costly.
Why this role
This Machine Learning Expert role pays $75/hr for Data Science judgment from someone trained in the field.
Skills and categories
More jobs in these fields:
Related jobs
Verified reviews
Community reviews
Leave your review
Common questions
Can I use Handshake if I graduated years ago?
Handshake's AI Fellowship roles are aimed at current students and people within about 1 to 2 years of graduating. If you graduated earlier, look at the other platforms on this board too.
Is Handshake itself the employer for AI training roles?
For AI Fellowship roles, yes, Handshake is the employer of record. For other listings on Handshake, the employer is the company that posted the job.
Can I choose my own hours?
Usually, yes. You log in when you want, pick up a task, finish it and submit it, with no meetings. Other people work from the same pool of tasks, so some days there may be no work until more is added.
Do task-based AI training roles require an interview?
Most use an online assessment or a test task instead of a live interview. When the listing says which, it's in the role details on this listing.
What does Data Science work look like for a Machine Learning Expert?
You check AI answers to Data Science questions, correct their errors and write expert reasoning. As a Machine Learning Expert, you're hired for that judgment, so hands-on Data Science experience matters.
How much does this specific role pay?
This listing is posted at $75/hr, an hourly rate. Pay can change after we check the listing, so confirm the rate on the platform's application page.
What happens when I click Apply on this listing?
Apply opens Handshake's site, where you create an account and follow its sign-up steps.
Is a PhD required?
For this role, yes, or similar professional depth, and the assessment checks it. PhD candidates and people with published research have qualified without the degree.
Are Handshake AI training listings internships?
Some are. Handshake lists internships and separate "AI Trainer" fellowships. If the description says "1099" or "Contract", the role is freelance work.