Test Platform Takes on Generative AI Apps
Rohde & Schwarz and the China Mobile Research Institute demonstrated an innovative testing solution for generative AI applications, leveraging the CMX500 5G one-box signaling tester. The platform enables quantitative measurement of the end-user experience of generative AI applications under diverse network conditions.
Testing solutions for generative AI are limited. The industry lacks mature metrics and standardized test frameworks for evaluating user experience, with organizations such as 3GPP and GTI actively conducting related research.
The generative AI user experience testbed, demonstrated at MWC Shanghai 2026, addresses these challenges. In the test system architecture, the large language model (LLM) is deployed on the server side, or in the cloud, while the CMX500 radio communication tester establishes a radio connection with a smart terminal running a client-side test application.
The CMX500 flexibly configures network parameters, channel fading models, latency, jitter, RF impairments, and other variables. It leads to realistic simulation of a wide range of wireless environments, from ideal coverage to weak-signal edge conditions.
Users can measure key performance indicators such as Time to First Token (TTFT) and Tokens Per Second (TPS), and generate corresponding charts. This enables quantitative evaluation and comparison of the user experience under different network conditions. It can support optimization of on-device generative AI application design and provide valuable reference points for future network optimization.
Related links:
More New Products
About the Author
Alix Paultre
Editor-at-Large, Microwaves & RF
Alix is Editor-at-Large for Microwaves & RF.
An Army veteran, Alix Paultre was a signals intelligence soldier on the East/West German border in the early ‘80s, and eventually wound up helping launch and run a publication on consumer electronics for the U.S. military stationed in Europe. Alix first began in this industry in 1998 at Electronic Products magazine, and since then has worked for a variety of publications, most recently as Editor-in-Chief of Power Systems Design.
Alix currently lives in Wiesbaden, Germany.