Rustem Feyzkhanov – Medium

Rustem Feyzkhanov

Pinned

Published in

AWS in Plain English

Serverless compute for LLM — with a step-by-step guide for hosting Mistral 7B on AWS Lambda

One of the challenges with using LLM in production is finding the right way to host the models in the cloud. GPUs are expensive so hosting…

Nov 16, 2023

Serverless compute for LLM — with a step-by-step guide for hosting Mistral 7B on AWS Lambda

Nov 16, 2023

Pinned

Published in

AWS in Plain English

Guide for running Llama 2 using LLAMA.CPP on AWS Fargate

Step-by-step guide for deploying Llama 2 model to AWS using LLAMA.CPP as framework, Fargate for hardware and Copilot for deployment.

Oct 17, 2023

Guide for running Llama 2 using LLAMA.CPP on AWS Fargate

Oct 17, 2023

Pinned

Published in

AWS Tip

How AWS Lambda SnapStart eliminates cold starts for Serverless Machine Learning Inference

How AWS Lambda SnapStart Removes cold starts for Serverless Machine Learning Inference by loading the model into the snapshot.

Nov 29, 2022

How AWS Lambda SnapStart eliminates cold starts for Serverless Machine Learning Inference

Nov 29, 2022

Published in

AWS in Plain English

Speeding Up Large Language Model (LLM) Inference with AWS Lambda SnapStart

This week AWS announced AWS Lambda SnapStart for Python and .NET functions. That’s a big deal. Why? One of the main challenges with…

Nov 19, 2024

Speeding Up Large Language Model (LLM) Inference with AWS Lambda SnapStart

Nov 19, 2024

Published in

AWS in Plain English

Top 20 AWS re:Invent 2024 breakout sessions to stay on top of everything related to generative AI

Generative AI continues to transform industries, making it crucial for businesses to stay updated on the latest advancements and best…

Sep 25, 2024

Top 20 AWS re:Invent 2024 breakout sessions to stay on top of everything related to generative AI

Sep 25, 2024

Published in

AWS in Plain English

Making LLMs Scalable: Cloud Inference with AWS Fargate and Copilot

In this blog post, I’ll take you through a step-by-step guide on how to get LLMs up and running in the cloud with AWS Fargate and Copilot.

Aug 7, 2023

Making LLMs Scalable: Cloud Inference with AWS Fargate and Copilot

Aug 7, 2023

Published in

AWS Tip

Scalable Cloud inference endpoint using ONNX and AWS Fargate

As a Machine Learning Engineer, I often find myself deploying models to the cloud. It’s an essential part of getting our models out of the…

May 22, 2023

Scalable Cloud inference endpoint using ONNX and AWS Fargate

May 22, 2023

ML No/Low Code services and Use Cases @ Re:Invent 2022

Machine Learning is becoming essential for a lot of industries, but setting ML projects for success is challenging and requires business…

Nov 14, 2022

ML No/Low Code services and Use Cases @ Re:Invent 2022

Nov 14, 2022

12 MLOps breakout sessions I’m looking forward to at Re:Invent 2022

MLOps is a field of best practices for companies to run ML workflows in production. It encompasses a large stack of tasks from optimizing…

Nov 8, 2022

12 MLOps breakout sessions I’m looking forward to at Re:Invent 2022

Nov 8, 2022

7 things to know before using AWS Panorama

Machine learning is becoming essential for a lot of companies and they want to use it to optimize their operations and make new services…

Nov 26, 2021

7 things to know before using AWS Panorama

Nov 26, 2021

Rustem Feyzkhanov

Rustem Feyzkhanov

I'm a staff machine learning engineer at Instrumental, where I work on analytical models for the manufacturing industry, and AWS Machine Learning Hero.

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech