Yes, delete the patch for this test. Just be aware that later tests may require you to reinstate (checkout) the patch again.
NB: "PROJECT=Generic ARCH=x86_64 scripts/unpack bluez" will only unpack/patch the package and "scripts/build bluez" will build the package without requiring the full "walk the tree" process of the buildsystem. It might help speed up the initial "get the patches right" process. If all is good the "make image" command will then package everything into an image.