Engineering Elevation

Write

Evaluating Text Generation with BERTScore, ROUGE, and BLEU in the Era of LLMs and GenAI

Aug 23, 20244 min read

Techniques and Tools for Communication in Distributed Training

Aug 1, 20244 min read

Integrating AWS X-Ray in Long-Running Processes: Avoiding Resource Exhaustion

Introduction: AWS X-Ray is a useful tool for gaining insights into distributed systems by tracing requests across different services. However, when integrating X-Ray into long-running processes, improper usage can lead to resource exhaustion. This ar...

Oct 3, 20245 min read

Understanding Memory and Throughput in LLMs Training: A Practical Example

Jul 26, 20243 min read

Understanding Fully Sharded Data Parallel (FSDP) in Distributed Training

Jun 29, 20244 min read

Understanding the Components of Distributed Training

In distributed training, several key components work together to enable efficient and scalable machine learning. These components include communication libraries, training frameworks, and hardware (GPUs). This blog post introduces these components, t...

Jun 29, 20243 min read

Understanding Reduce-Scatter, All-Gather, and All-Reduce in Distributed Computing for LLM Training

In the world of parallel computing, particularly in distributed machine learning and high-performance computing, collective communication operations play a crucial role. Among these operations, reduce-scatter, all-gather, and all-reduce are commonly ...

Jun 29, 20245 min read

My Journey into Front-End Development with AWS Amplify

1. My Background and Why I'm Learning Front-End Development As an AWS backend engineer, I've spent years mastering the intricacies of server-side development. However, I've always been curious about the other side of the spectrum - front-end developm...

Jun 26, 20243 min read

Deleted the Database: A Tech Pro's Guide to Handling Major Oops Moments

Last week, at a little past 8 PM, my phone pinged with a Slack message from a former mentee, Alex. Alex, who is both ASD and ADHD, had some initial hiccups fitting into the workplace, and I had mentored him through those early days. Even though he ha...

Apr 22, 20242 min read

Getting Started with Your First Discord Bot Using Node.js

Creating a Discord bot can be a fun and rewarding project, especially if you're looking to add some automation or interactivity to your Discord server. In this blog, we'll walk you through the steps to create a simple Discord bot using Node.js and ad...

Mar 12, 20243 min read

Building a Chatbot with AWS Bedrock and AWS Lambda

What is AWS Bedrock? AWS Bedrock is a managed service that provides access to a variety of foundation models for natural language processing, computer vision, and other AI tasks. It allows developers to easily integrate AI capabilities into their app...

Mar 4, 20242 min read

Command Palette

Latest articles