diff --git a/.changeset/unlucky-squids-drop.md b/.changeset/unlucky-squids-drop.md
new file mode 100644
index 0000000000..644766f2f9
--- /dev/null
+++ b/.changeset/unlucky-squids-drop.md
@@ -0,0 +1,9 @@
+---
+'@backstage/cli': patch
+---
+
+Ignore setupTests and the file inside ./dev folder recursively. Eslint
+can not resolve relative paths as we defined in the rule import/no-extraneous-dependencies, and it does not apply this rule.
+
+A downside to use a recursive definition would be to checking all `dev` folders, which might not be wanted. Ensure you don't use
+the `dev` folder out of scope (must be used for dev. env. only)