https://haanjack.github.io/news/announcement_1/ 2015-10-22T19:59:00+00:00 https://haanjack.github.io/news/announcement_2/ 2015-11-07T20:11:00+00:00 https://haanjack.github.io/news/announcement_3/ 2016-01-15T11:59:00+00:00 https://haanjack.github.io/blog/2023/cupy/ 2023-01-01T00:00:00+00:00 https://haanjack.github.io/blog/2023/numba/ 2023-01-02T00:00:00+00:00 https://haanjack.github.io/blog/2023/triton/ 2023-01-03T00:00:00+00:00 https://haanjack.github.io/blog/2023/pycuda/ 2023-01-04T00:00:00+00:00 https://haanjack.github.io/blog/2023/swag-integration/ 2023-01-05T00:00:00+00:00 https://haanjack.github.io/blog/2023/torchdynamo/ 2023-01-06T00:00:00+00:00 https://haanjack.github.io/blog/2023/nvfuser/ 2023-01-07T00:00:00+00:00 https://haanjack.github.io/blog/2023/table-of-contents/ 2023-03-20T15:59:00+00:00 https://haanjack.github.io/blog/2023/tables/ 2023-03-20T18:37:00+00:00 https://haanjack.github.io/blog/2023/nccl-collectives/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/pytorch-collectives/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/GPU-topology/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/reduce-scatter-vs-allreduce/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/gpu-server/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/superpod-deepdive/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/GPU-vs-TPU/ 2023-04-01T16:40:16+00:00 https://haanjack.github.io/blog/2023/videos/ 2023-04-24T21:01:00+00:00 https://haanjack.github.io/blog/2023/audios/ 2023-04-25T10:25:00+00:00 https://haanjack.github.io/blog/2023/sidebar-table-of-contents/ 2023-04-25T14:14:00+00:00 https://haanjack.github.io/blog/2023/llm-engineerings/ 2023-05-06T00:01:00+00:00 https://haanjack.github.io/blog/2023/custom-blockquotes/ 2023-05-12T19:53:00+00:00 https://haanjack.github.io/blog/2023/kernel-fusion/ 2023-06-02T00:00:00+00:00 https://haanjack.github.io/blog/2023/kv-caching/ 2023-06-03T00:00:00+00:00 https://haanjack.github.io/blog/2023/continual-batching/ 2023-06-04T00:00:00+00:00 https://haanjack.github.io/blog/2023/quantization/ 2023-06-05T00:00:00+00:00 https://haanjack.github.io/blog/2023/speculative-decoding/ 2023-06-06T00:00:00+00:00 https://haanjack.github.io/blog/2023/sparsity/ 2023-06-07T00:00:00+00:00 https://haanjack.github.io/blog/2023/jupyter-notebook/ 2023-07-04T12:57:00+00:00 https://haanjack.github.io/blog/2023/driver-installation/ 2023-09-01T00:00:00+00:00 https://haanjack.github.io/blog/2023/nvidia-smi/ 2023-09-02T00:00:00+00:00 https://haanjack.github.io/blog/2023/compatibility-mode/ 2023-09-03T00:00:00+00:00 https://haanjack.github.io/blog/2023/grokking-hgx/ 2023-09-04T00:00:00+00:00 https://haanjack.github.io/blog/2023/gpu-management/ 2023-09-05T00:00:00+00:00 https://haanjack.github.io/blog/2023/tikzjax/ 2023-12-12T22:25:00+00:00 https://haanjack.github.io/blog/2024/computing-size/ 2024-01-01T00:00:00+00:00 https://haanjack.github.io/blog/2024/techniques/ 2024-01-02T00:00:00+00:00 https://haanjack.github.io/blog/2024/linked-list/ 2024-01-03T00:00:00+00:00 https://haanjack.github.io/blog/2024/dynamic-programming/ 2024-01-04T00:00:00+00:00 https://haanjack.github.io/blog/2024/hashtable/ 2024-01-04T00:00:00+00:00 https://haanjack.github.io/blog/2024/graph/ 2024-01-05T00:00:00+00:00 https://haanjack.github.io/blog/2024/greedy/ 2024-01-07T00:00:00+00:00 https://haanjack.github.io/blog/2024/shortest-path/ 2024-01-08T00:00:00+00:00 https://haanjack.github.io/blog/2024/backtracking/ 2024-01-09T00:00:00+00:00 https://haanjack.github.io/blog/2024/LRU/ 2024-01-10T00:00:00+00:00 https://haanjack.github.io/blog/2024/chartjs/ 2024-01-26T01:04:00+00:00 https://haanjack.github.io/blog/2024/echarts/ 2024-01-26T16:03:00+00:00 https://haanjack.github.io/blog/2024/geojson-map/ 2024-01-26T17:57:00+00:00 https://haanjack.github.io/blog/2024/vega-lite/ 2024-01-27T00:20:00+00:00 https://haanjack.github.io/blog/2024/advanced-images/ 2024-01-27T11:46:00+00:00 https://haanjack.github.io/blog/2024/code-diff/ 2024-01-27T19:22:00+00:00 https://haanjack.github.io/blog/2024/pseudocode/ 2024-04-15T00:01:00+00:00 https://haanjack.github.io/blog/2024/post-citation/ 2024-04-28T15:06:00+00:00 https://haanjack.github.io/blog/2024/typograms/ 2024-04-29T23:36:10+00:00 https://haanjack.github.io/blog/2024/tabs/ 2024-05-01T00:32:13+00:00 https://haanjack.github.io/blog/2024/photo-gallery/ 2024-12-04T01:59:00+00:00 https://haanjack.github.io/blog/2025/introduction/ 2025-01-01T00:00:00+00:00 https://haanjack.github.io/blog/2025/Amphere/ 2025-01-01T00:00:00+00:00 https://haanjack.github.io/blog/2025/data-parallelism/ 2025-01-02T00:00:00+00:00 https://haanjack.github.io/blog/2025/Hopper/ 2025-01-02T00:00:00+00:00 https://haanjack.github.io/blog/2025/FlashAttention/ 2025-01-02T00:00:00+00:00 https://haanjack.github.io/blog/2025/pipeline-parallelism/ 2025-01-03T00:00:00+00:00 https://haanjack.github.io/blog/2025/Lovelace/ 2025-01-03T00:00:00+00:00 https://haanjack.github.io/blog/2025/FlashAttention2/ 2025-01-03T00:00:00+00:00 https://haanjack.github.io/blog/2025/tensor-parallelism/ 2025-01-04T00:00:00+00:00 https://haanjack.github.io/blog/2025/Blackwell/ 2025-01-04T00:00:00+00:00 https://haanjack.github.io/blog/2025/FlashAttention3/ 2025-01-04T00:00:00+00:00 https://haanjack.github.io/blog/2025/context-parallelism/ 2025-01-05T00:00:00+00:00 https://haanjack.github.io/blog/2025/expert-parallelism/ 2025-01-06T00:00:00+00:00 https://haanjack.github.io/blog/2025/sharding-optimizer/ 2025-01-07T00:00:00+00:00 https://haanjack.github.io/blog/2025/offloading/ 2025-01-08T00:00:00+00:00 https://haanjack.github.io/blog/2025/long-context/ 2025-01-09T00:00:00+00:00 https://haanjack.github.io/blog/2025/sparse-attention/ 2025-01-09T00:00:00+00:00 https://haanjack.github.io/blog/2025/plotly/ 2025-03-26T14:24:00+00:00 https://haanjack.github.io/about https://haanjack.github.io/_pages/archive/ https://haanjack.github.io/books/ https://haanjack.github.io/archive-categories/ https://haanjack.github.io/archive-chronicle/ https://haanjack.github.io/cv/ https://haanjack.github.io/llm/ https://haanjack.github.io/mlsys/ https://haanjack.github.io/search/ https://haanjack.github.io/archive-tags/ https://haanjack.github.io/blog/2023/ https://haanjack.github.io/blog/2024/ https://haanjack.github.io/blog/2025/ https://haanjack.github.io/blog/tag/formatting/ https://haanjack.github.io/blog/tag/toc/ https://haanjack.github.io/blog/tag/tables/ https://haanjack.github.io/blog/tag/links/ https://haanjack.github.io/blog/tag/videos/ https://haanjack.github.io/blog/tag/audios/ https://haanjack.github.io/blog/tag/sidebar/ https://haanjack.github.io/blog/tag/llm/ https://haanjack.github.io/blog/tag/blockquotes/ https://haanjack.github.io/blog/tag/jupyter/ https://haanjack.github.io/blog/tag/diagrams/ https://haanjack.github.io/blog/tag/charts/ https://haanjack.github.io/blog/tag/maps/ https://haanjack.github.io/blog/tag/images/ https://haanjack.github.io/blog/tag/code/ https://haanjack.github.io/blog/tag/citation/ https://haanjack.github.io/blog/category/sample-posts/ https://haanjack.github.io/blog/category/llm/ https://haanjack.github.io/blog/category/engineering/ https://haanjack.github.io/blog/category/distributed/ https://haanjack.github.io/blog/category/computing/ https://haanjack.github.io/ https://haanjack.github.io/page/2/ https://haanjack.github.io/page/3/ https://haanjack.github.io/page/4/ https://haanjack.github.io/page/5/ https://haanjack.github.io/page/6/ https://haanjack.github.io/page/7/ https://haanjack.github.io/page/8/ https://haanjack.github.io/page/9/ https://haanjack.github.io/page/10/ https://haanjack.github.io/page/11/ https://haanjack.github.io/page/12/ https://haanjack.github.io/page/13/ https://haanjack.github.io/page/14/ https://haanjack.github.io/page/15/