.github/workflows: Remove cache steps from test-build.yml

.github/workflows: Remove cache steps from test-build.yml #216