ci: Reduce number of workers back to 20

Now that we've past 2.6.0-rc1 reduce number of works back to 20.

Signed-off-by: Kumar Gala <kumar.gala@linaro.org>
1 file changed