🍋 SEO Tools

Robots.txt Analyzer

Parse and test robots.txt rules against URLs

Free ブラウザのみ No sign-up

入力

chars words sentences lines

2つ目の入力

分析オプション

テストURLパス

{# seo-og-debug, seo-headings, seo-readability, seo-links, seo-canonical, seo-structured-data, seo-word-count have no user-facing options — panel omitted #} {# ═══════════════════════════════════════════════════════════════ MATH TOOL OPTIONS (math-* engines) ═══════════════════════════════════════════════════════════════ #}

結果

Robots.txt Analyzerについて

Paste your robots.txt content and test whether specific URLs are allowed or blocked for different user agents. Identify syntax errors and common configuration mistakes.

仕組み

The tool parses robots.txt according to the Robots Exclusion Protocol. It groups rules by user-agent, resolves wildcards and $ anchors, and tests URLs against the most specific matching rule.

ステップごとの使い方

1 [
2 '
3 P
4 a
5 s
6 t
7 e
8
9 y
10 o
11 u
12 r
13
14 r
15 o
16 b
17 o
18 t
19 s
20 .
21 t
22 x
23 t
24
25 c
26 o
27 n
28 t
29 e
30 n
31 t
32
33 i
34 n
35 t
36 o
37
38 t
39 h
40 e
41
42 i
43 n
44 p
45 u
46 t
47
48 a
49 r
50 e
51 a
52 '
53 ,
54
55 '
56 E
57 n
58 t
59 e
60 r
61
62 a
63
64 U
65 R
66 L
67
68 t
69 o
70
71 t
72 e
73 s
74 t
75
76 i
77 n
78
79 t
80 h
81 e
82
83 o
84 p
85 t
86 i
87 o
88 n
89 s
90
91 p
92 a
93 n
94 e
95 l
96 '
97 ,
98
99 '
100 C
101 l
102 i
103 c
104 k
105
106 A
107 n
108 a
109 l
110 y
111 z
112 e
113
114 t
115 o
116
117 s
118 e
119 e
120
121 p
122 a
123 r
124 s
125 e
126 d
127
128 r
129 u
130 l
131 e
132 s
133
134 a
135 n
136 d
137
138 t
139 e
140 s
141 t
142
143 r
144 e
145 s
146 u
147 l
148 t
149 s
150 '
151 ]

ヒント

[
'
A
l
w
a
y
s
i
n
c
l
u
d
e
a
S
i
t
e
m
a
p
d
i
r
e
c
t
i
v
e
p
o
i
n
t
i
n
g
t
o
y
o
u
r
s
i
t
e
m
a
p
.
x
m
l
'
,
"
U
s
e
'
U
s
e
r
-
a
g
e
n
t
:
*
'
f
o
r
r
u
l
e
s
t
h
a
t
a
p
p
l
y
t
o
a
l
l
c
r
a
w
l
e
r
s
"
,
'
B
e
c
a
r
e
f
u
l
w
i
t
h
D
i
s
a
l
l
o
w
:
/
—
i
t
b
l
o
c
k
s
y
o
u
r
e
n
t
i
r
e
s
i
t
e
'
,
'
T
e
s
t
c
r
i
t
i
c
a
l
p
a
g
e
s
l
i
k
e
/
b
l
o
g
/
a
n
d
/
p
r
o
d
u
c
t
s
/
i
n
d
i
v
i
d
u
a
l
l
y
'
]

Categories

Robots.txt Analyzer

分析オプション

結果

Robots.txt Analyzerについて

仕組み

ステップごとの使い方

ヒント

よくある質問