In recent years, a new performance that combines dance with visual effects attracts a lot of attention. However, it is difficult to operate the existing visual effect generation tools during performance because they were operated by PC interfaces such as a keyboard. On the other hand, if another person operates it, it is difficult to reflect the intention of performer correctly. Therefore, in this study, we propose a visual effects controlling system by performer’s movement. In the system, a performer wears a cloth equipped with multiple LEDs, and the system recognizes physical movement by detecting LEDs using a camera, and changes visual effects according to predescribed scripts. We have actually used our prototype system on an event stage of Kobe Luminarie in 2008.