Rustem Feyzkhanov – Medium

Rustem Feyzkhanov

Pinned

Published in
AWS in Plain English

Serverless compute for LLM — with a step-by-step guide for hosting Mistral 7B on AWS Lambda

One of the challenges with using LLM in production is finding the right way to host the models in the cloud. GPUs are expensive so hosting…

Nov 16, 2023

Serverless compute for LLM — with a step-by-step guide for hosting Mistral 7B on AWS Lambda

Nov 16, 2023

Pinned

Published in
AWS in Plain English

Guide for running Llama 2 using LLAMA.CPP on AWS Fargate

Step-by-step guide for deploying Llama 2 model to AWS using LLAMA.CPP as framework, Fargate for hardware and Copilot for deployment.

Oct 17, 2023

Guide for running Llama 2 using LLAMA.CPP on AWS Fargate

Oct 17, 2023

Pinned

Published in
AWS Tip

How AWS Lambda SnapStart eliminates cold starts for Serverless Machine Learning Inference

How AWS Lambda SnapStart Removes cold starts for Serverless Machine Learning Inference by loading the model into the snapshot.

Nov 29, 2022

How AWS Lambda SnapStart eliminates cold starts for Serverless Machine Learning Inference

Nov 29, 2022

Published in
AWS in Plain English

Speeding Up Large Language Model (LLM) Inference with AWS Lambda SnapStart

This week AWS announced AWS Lambda SnapStart for Python and .NET functions. That’s a big deal. Why? One of the main challenges with…

1d ago

Speeding Up Large Language Model (LLM) Inference with AWS Lambda SnapStart

1d ago

Published in
AWS in Plain English

Top 20 AWS re:Invent 2024 breakout sessions to stay on top of everything related to generative AI

Generative AI continues to transform industries, making it crucial for businesses to stay updated on the latest advancements and best…

Sep 25

Top 20 AWS re:Invent 2024 breakout sessions to stay on top of everything related to generative AI

Sep 25

Published in
AWS in Plain English

Making LLMs Scalable: Cloud Inference with AWS Fargate and Copilot

In this blog post, I’ll take you through a step-by-step guide on how to get LLMs up and running in the cloud with AWS Fargate and Copilot.

Aug 7, 2023

Making LLMs Scalable: Cloud Inference with AWS Fargate and Copilot

Aug 7, 2023

Published in
AWS Tip

Scalable Cloud inference endpoint using ONNX and AWS Fargate

As a Machine Learning Engineer, I often find myself deploying models to the cloud. It’s an essential part of getting our models out of the…

May 22, 2023

Scalable Cloud inference endpoint using ONNX and AWS Fargate

May 22, 2023

ML No/Low Code services and Use Cases @ Re:Invent 2022

Machine Learning is becoming essential for a lot of industries, but setting ML projects for success is challenging and requires business…

Nov 14, 2022

ML No/Low Code services and Use Cases @ Re:Invent 2022

Nov 14, 2022

12 MLOps breakout sessions I’m looking forward to at Re:Invent 2022

MLOps is a field of best practices for companies to run ML workflows in production. It encompasses a large stack of tasks from optimizing…

Nov 8, 2022

12 MLOps breakout sessions I’m looking forward to at Re:Invent 2022

Nov 8, 2022

7 things to know before using AWS Panorama

Machine learning is becoming essential for a lot of companies and they want to use it to optimize their operations and make new services…

Nov 26, 2021

7 things to know before using AWS Panorama

Nov 26, 2021

Rustem Feyzkhanov

Rustem Feyzkhanov

I'm a staff machine learning engineer at Instrumental, where I work on analytical models for the manufacturing industry, and AWS Machine Learning Hero.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams