I just realized: for each individual pass of Instant Radiosity, only one bounce of diffuse illumination can be evaluated. (At least true in my current implementation.) So to have a relative complete GI effect, many passes are necessary.
Now I understand why Monte-Carlo Radiosity still takes the major role.