hidden size 2048 of Qwen3-30B-A3B is not supported

[GuoxiangZu]

When we run the sglang inference with --enable-deepep-moe on Qwen3-30B-A3B, the following error occurs:

raceback (most recent call last):
  File "/sgl-workspace/sglang/python/sglang/srt/managers/scheduler.py", line 2546, in run_scheduler_process
    scheduler = Scheduler(server_args, port_args, gpu_id, tp_rank, pp_rank, dp_rank)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/sgl-workspace/sglang/python/sglang/srt/managers/scheduler.py", line 312, in __init__
    self.tp_worker = TpWorkerClass(
                     ^^^^^^^^^^^^^^
  File "/sgl-workspace/sglang/python/sglang/srt/managers/tp_worker_overlap_thread.py", line 64, in __init__
    self.worker = TpModelWorker(
                  ^^^^^^^^^^^^^^
  File "/sgl-workspace/sglang/python/sglang/srt/managers/tp_worker.py", line 78, in __init__
    self.model_runner = ModelRunner(
                        ^^^^^^^^^^^^
  File "/sgl-workspace/sglang/python/sglang/srt/model_executor/model_runner.py", line 212, in __init__
    self.initialize(min_per_gpu_memory)
  File "/sgl-workspace/sglang/python/sglang/srt/model_executor/model_runner.py", line 287, in initialize
    self.init_cuda_graphs()
  File "/sgl-workspace/sglang/python/sglang/srt/model_executor/model_runner.py", line 1138, in init_cuda_graphs
    self.cuda_graph_runner = CudaGraphRunner(self)
                             ^^^^^^^^^^^^^^^^^^^^^
  File "/sgl-workspace/sglang/python/sglang/srt/model_executor/cuda_graph_runner.py", line 320, in __init__
    raise Exception(
Exception: Capture cuda graph failed: Failed: Assertion error /sgl-workspace/DeepEP/csrc/kernels/internode_ll.cu:381 'false && "Unsupported hidden"'

It is due to hidden size 2048 is not supported yet.

[alpha-baby]

DeepEP/csrc/kernels/launch.cuh

Lines 85 to 92 in 9d4f7ef

	#define SWITCH_HIDDEN(case_macro) \
	switch (hidden) { \
	case 2560: case_macro(2560); \
	case 4096: case_macro(4096); \
	case 5120: case_macro(5120); \
	case 7168: case_macro(7168); \
	default: EP_HOST_ASSERT(false && "Unsupported hidden"); \
	} while (false)

you can try add one line code, like:

 #define SWITCH_HIDDEN(case_macro) \ 
     switch (hidden) { \ 
         case 2048: case_macro(2048); \ 
         case 2560: case_macro(2560); \ 
         case 4096: case_macro(4096); \ 
         case 5120: case_macro(5120); \ 
         case 7168: case_macro(7168); \ 
         default: EP_HOST_ASSERT(false && "Unsupported hidden"); \ 
     } while (false) 

[LyricZhao]

Fixed in 7b0c25f, thanks for pointing it out.