Integrating AWS X-Ray in Long-Running Processes: Avoiding Resource Exhaustion

Integrating AWS X-Ray in Long-Running Processes: Avoiding Resource Exhaustion

Introduction: AWS X-Ray is a useful tool for gaining insights into distributed systems by tracing requests across different services. However, when integrating X-Ray into long-running processes, improper usage can lead to resource exhaustion. This ar...

Denny Wang
Denny Wang
5 min read
Evaluating Text Generation with BERTScore, ROUGE, and BLEU in the Era of LLMs and GenAI

Evaluating Text Generation with BERTScore, ROUGE, and BLEU in the Era of LLMs and GenAI

Denny Wang
Denny Wang
4 min read
Techniques and Tools for Communication in Distributed Training

Techniques and Tools for Communication in Distributed Training

Denny Wang
Denny Wang
4 min read
Denny Wang

Denny Wang

2 followers

Through this blog, I aim to share my insights, learnings, and the innovative spirit of AI and cloud engineering beyond the corporate horizon.

Understanding Memory and Throughput in LLMs Training: A Practical Example

Understanding Memory and Throughput in LLMs Training: A Practical Example

Denny Wang
4 min read
Understanding Fully Sharded Data Parallel (FSDP) in Distributed Training

Understanding Fully Sharded Data Parallel (FSDP) in Distributed Training

Denny Wang
4 min read
Understanding the Components of Distributed Training

Understanding the Components of Distributed Training

Denny Wang
3 min read
Understanding Reduce-Scatter, All-Gather, and All-Reduce in Distributed Computing for LLM Training

Understanding Reduce-Scatter, All-Gather, and All-Reduce in Distributed Computing for LLM Training

Denny Wang
5 min read
My Journey into Front-End Development with AWS Amplify

My Journey into Front-End Development with AWS Amplify

Denny Wang
3 min read
Deleted the Database: A Tech Pro's Guide to Handling Major Oops Moments

Deleted the Database: A Tech Pro's Guide to Handling Major Oops Moments

Denny Wang
2 min read
Getting Started with Your First Discord Bot Using Node.js

Getting Started with Your First Discord Bot Using Node.js

Denny Wang
3 min read
Building a Chatbot with AWS Bedrock and AWS Lambda

Building a Chatbot with AWS Bedrock and AWS Lambda

Denny Wang
2 min read
Cross-Partition Access in AWS: A Dual-IAM User Strategy

Cross-Partition Access in AWS: A Dual-IAM User Strategy

Denny Wang
14 min read