diff --git a/spring-shell-docs/src/main/asciidoc/using-spring-shell.adoc b/spring-shell-docs/src/main/asciidoc/using-spring-shell.adoc
index 067cd7af..e1922568 100644
--- a/spring-shell-docs/src/main/asciidoc/using-spring-shell.adoc
+++ b/spring-shell-docs/src/main/asciidoc/using-spring-shell.adoc
@@ -41,10 +41,13 @@ configuring only the necessary beans as needed:
 ...
 ----
 
+[CAUTION]
+====
 Given that Spring Shell will kick in and start the REPL by virtue of this dependency being present,
 you'll need to either build skipping tests (`-DskipTests`) throughout this tutorial or remove the sample integration test
 that was generated by http://start.spring.io. If you don't do so, the integration test will create
-the Spring `ApplicationContext` and stay stuck in the eval loop.
+the Spring `ApplicationContext` and, depending on your build tool, will stay stuck in the eval loop or crash with a NPE.
+====
 
 ==== Your first command
 It's time to add our first command. Create a new class (name it however you want) and