Rustem Feyzkhanov – Medium

Rustem Feyzkhanov

Pinned

Rustem Feyzkhanov
in
AWS in Plain English

Serverless compute for LLM — with a step-by-step guide for hosting Mistral 7B on AWS Lambda

One of the challenges with using LLM in production is finding the right way to host the models in the cloud. GPUs are expensive so hosting…

6 min readNov 16, 2023

--

7

Serverless compute for LLM — with a step-by-step guide for hosting Mistral 7B on AWS Lambda

--

7

Pinned

Rustem Feyzkhanov
in
AWS in Plain English

Guide for running Llama 2 using LLAMA.CPP on AWS Fargate

Step-by-step guide for deploying Llama 2 model to AWS using LLAMA.CPP as framework, Fargate for hardware and Copilot for deployment.

5 min readOct 17, 2023

--

1

Guide for running Llama 2 using LLAMA.CPP on AWS Fargate

--

1

Pinned

Rustem Feyzkhanov
in
AWS Tip

How AWS Lambda SnapStart eliminates cold starts for Serverless Machine Learning Inference

How AWS Lambda SnapStart Removes cold starts for Serverless Machine Learning Inference by loading the model into the snapshot.

4 min readNov 29, 2022

--

How AWS Lambda SnapStart eliminates cold starts for Serverless Machine Learning Inference

--

Rustem Feyzkhanov
in
AWS in Plain English

Making LLMs Scalable: Cloud Inference with AWS Fargate and Copilot

In this blog post, I’ll take you through a step-by-step guide on how to get LLMs up and running in the cloud with AWS Fargate and Copilot.

5 min readAug 7, 2023

--

Making LLMs Scalable: Cloud Inference with AWS Fargate and Copilot

--

Rustem Feyzkhanov
in
AWS Tip

Scalable Cloud inference endpoint using ONNX and AWS Fargate

As a Machine Learning Engineer, I often find myself deploying models to the cloud. It’s an essential part of getting our models out of the…

6 min readMay 22, 2023

--

Scalable Cloud inference endpoint using ONNX and AWS Fargate

--

Rustem Feyzkhanov

ML No/Low Code services and Use Cases @ Re:Invent 2022

Machine Learning is becoming essential for a lot of industries, but setting ML projects for success is challenging and requires business…

4 min readNov 14, 2022

--

ML No/Low Code services and Use Cases @ Re:Invent 2022

--

Rustem Feyzkhanov

12 MLOps breakout sessions I’m looking forward to at Re:Invent 2022

MLOps is a field of best practices for companies to run ML workflows in production. It encompasses a large stack of tasks from optimizing…

4 min readNov 8, 2022

--

12 MLOps breakout sessions I’m looking forward to at Re:Invent 2022

--

Rustem Feyzkhanov

7 things to know before using AWS Panorama

Machine learning is becoming essential for a lot of companies and they want to use it to optimize their operations and make new services…

4 min readNov 26, 2021

--

7 things to know before using AWS Panorama

--

Rustem Feyzkhanov

7 MLOps breakout sessions I’m looking forward to at Re:Invent 2021

MLOps is an emerging field of best practices for businesses to run Machine Learning workflows in production. MLOps captures a very wide…

3 min readNov 16, 2021

--

7 MLOps breakout sessions I’m looking forward to at Re:Invent 2021

--

Rustem Feyzkhanov
in
AWS Tip

Machine Learning Inference on AWS Lambda Functions powered by AWS Graviton2 Processors

Machine Learning became a necessity for a lot of companies — from Fortune 500 companies to small startups. With all the frameworks and…

5 min readSep 29, 2021

--

Machine Learning Inference on AWS Lambda Functions powered by AWS Graviton2 Processors

--

Rustem Feyzkhanov

Rustem Feyzkhanov

I'm a staff machine learning engineer at Instrumental, where I work on analytical models for the manufacturing industry, and AWS Machine Learning Hero.

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams