Is CapsLock safe to use?

Yes. CapsLock is a simple, single-purpose utility that only toggles the CAPS LOCK key. It does not modify the registry, install drivers, or make any permanent system changes. It has been available from RJL Software since 2001.