About the role

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.

Responsibilities:

Compress and optimize large language and vision models for on-device inference.
Develop pipelines for model distillation and hardware-specific compilation.
Benchmark performance across various NPU/GPU architectures.

Qualifications:

Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
Strong C++ and Python skills.

Skills & Tags

python ai

Aplyr's read

Hyphen Connect is a tech innovator in connectivity solutions, employing diverse roles from risk management to marketing, with a strong focus on Mandarin speakers.
Synthesized from recent postings & public sources

What's promising

•Hyphen Connect is at the forefront of connectivity technology innovation.
•The company offers diverse roles, from risk management to tech consultancy.
•Opportunities for Mandarin speakers are abundant, indicating a focus on Asian markets.

What to watch

•High demand for Mandarin speakers may limit opportunities for non-speakers.
•The company appears to have a high turnover in compliance roles.
•Limited public information about company culture and work-life balance.

Why Hyphen Connect

•Hyphen Connect bridges traditional and decentralized finance roles.
•The company emphasizes roles in both tech and financial compliance sectors.
•Focus on Mandarin-speaking roles suggests strategic alignment with Asian markets.

Aplyr’s read is generated by AI from public sources. Was it useful?