Using “tail” to follow a file without displaying the most recent lines
I would like use a program like tail to follow a file as it's being written to, but not display the most recent lines.
For instance, when following a new file, no text will be displayed while the file is less than 30 lines. After more than 30 lines are written to the file, lines will be written to the screen starting at line 1.
So as lines 31-40 are written to the file, lines 1-10 will be written to the screen.
If there is no easy way to do this with tail, maybe a there's a way to write to a new file a prior line from the first file each time the first file is extended by a line, and the tail that new file...
linux command-line tail
New contributor
add a comment |
I would like use a program like tail to follow a file as it's being written to, but not display the most recent lines.
For instance, when following a new file, no text will be displayed while the file is less than 30 lines. After more than 30 lines are written to the file, lines will be written to the screen starting at line 1.
So as lines 31-40 are written to the file, lines 1-10 will be written to the screen.
If there is no easy way to do this with tail, maybe a there's a way to write to a new file a prior line from the first file each time the first file is extended by a line, and the tail that new file...
linux command-line tail
New contributor
add a comment |
I would like use a program like tail to follow a file as it's being written to, but not display the most recent lines.
For instance, when following a new file, no text will be displayed while the file is less than 30 lines. After more than 30 lines are written to the file, lines will be written to the screen starting at line 1.
So as lines 31-40 are written to the file, lines 1-10 will be written to the screen.
If there is no easy way to do this with tail, maybe a there's a way to write to a new file a prior line from the first file each time the first file is extended by a line, and the tail that new file...
linux command-line tail
New contributor
I would like use a program like tail to follow a file as it's being written to, but not display the most recent lines.
For instance, when following a new file, no text will be displayed while the file is less than 30 lines. After more than 30 lines are written to the file, lines will be written to the screen starting at line 1.
So as lines 31-40 are written to the file, lines 1-10 will be written to the screen.
If there is no easy way to do this with tail, maybe a there's a way to write to a new file a prior line from the first file each time the first file is extended by a line, and the tail that new file...
linux command-line tail
linux command-line tail
New contributor
New contributor
New contributor
asked 2 hours ago
ridthyselfridthyself
111
111
New contributor
New contributor
add a comment |
add a comment |
3 Answers
3
active
oldest
votes
Maybe buffer with awk:
tail -n +0 -f some/file | awk '{b[NR] = $0} NR > 30 {print b[NR-30]; delete b[NR-30]} END {for (i = NR - 29; i <= NR; i++) print b[i]}'
The awk code, expanded:
{
b[NR] = $0 # save the current line in a buffer array
}
NR > 30 { # once we have more than 30 lines
print b[NR-30]; # print the line from 30 lines ago
delete b[NR-30]; # and delete it
}
END { # once the pipe closes, print the rest
for (i = NR - 29; i <= NR; i++)
print b[i]
}
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
@ridthyself if you have GNU awk, try adding afflush();
after theprint b[NR-30];
. Maybe the output is being buffered.
– muru
53 mins ago
add a comment |
This isn't very efficient, because it will re-read the file every two seconds, but will do the job:
watch 'tail -n40 /path/to/file | head -n10'
add a comment |
Same as @muru's but using the modulo operator instead of storing and deleting:
tail -fn+1 some/file | awk -v n=30 '
NR > n {print s[NR % n]}
{s[NR % n] = $0}
END{for (i = NR - n + 1; i <= NR; i++) print s[i % n]}'
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
ridthyself is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f510178%2fusing-tail-to-follow-a-file-without-displaying-the-most-recent-lines%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
3 Answers
3
active
oldest
votes
3 Answers
3
active
oldest
votes
active
oldest
votes
active
oldest
votes
Maybe buffer with awk:
tail -n +0 -f some/file | awk '{b[NR] = $0} NR > 30 {print b[NR-30]; delete b[NR-30]} END {for (i = NR - 29; i <= NR; i++) print b[i]}'
The awk code, expanded:
{
b[NR] = $0 # save the current line in a buffer array
}
NR > 30 { # once we have more than 30 lines
print b[NR-30]; # print the line from 30 lines ago
delete b[NR-30]; # and delete it
}
END { # once the pipe closes, print the rest
for (i = NR - 29; i <= NR; i++)
print b[i]
}
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
@ridthyself if you have GNU awk, try adding afflush();
after theprint b[NR-30];
. Maybe the output is being buffered.
– muru
53 mins ago
add a comment |
Maybe buffer with awk:
tail -n +0 -f some/file | awk '{b[NR] = $0} NR > 30 {print b[NR-30]; delete b[NR-30]} END {for (i = NR - 29; i <= NR; i++) print b[i]}'
The awk code, expanded:
{
b[NR] = $0 # save the current line in a buffer array
}
NR > 30 { # once we have more than 30 lines
print b[NR-30]; # print the line from 30 lines ago
delete b[NR-30]; # and delete it
}
END { # once the pipe closes, print the rest
for (i = NR - 29; i <= NR; i++)
print b[i]
}
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
@ridthyself if you have GNU awk, try adding afflush();
after theprint b[NR-30];
. Maybe the output is being buffered.
– muru
53 mins ago
add a comment |
Maybe buffer with awk:
tail -n +0 -f some/file | awk '{b[NR] = $0} NR > 30 {print b[NR-30]; delete b[NR-30]} END {for (i = NR - 29; i <= NR; i++) print b[i]}'
The awk code, expanded:
{
b[NR] = $0 # save the current line in a buffer array
}
NR > 30 { # once we have more than 30 lines
print b[NR-30]; # print the line from 30 lines ago
delete b[NR-30]; # and delete it
}
END { # once the pipe closes, print the rest
for (i = NR - 29; i <= NR; i++)
print b[i]
}
Maybe buffer with awk:
tail -n +0 -f some/file | awk '{b[NR] = $0} NR > 30 {print b[NR-30]; delete b[NR-30]} END {for (i = NR - 29; i <= NR; i++) print b[i]}'
The awk code, expanded:
{
b[NR] = $0 # save the current line in a buffer array
}
NR > 30 { # once we have more than 30 lines
print b[NR-30]; # print the line from 30 lines ago
delete b[NR-30]; # and delete it
}
END { # once the pipe closes, print the rest
for (i = NR - 29; i <= NR; i++)
print b[i]
}
edited 53 mins ago
answered 2 hours ago
murumuru
36.8k589163
36.8k589163
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
@ridthyself if you have GNU awk, try adding afflush();
after theprint b[NR-30];
. Maybe the output is being buffered.
– muru
53 mins ago
add a comment |
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
@ridthyself if you have GNU awk, try adding afflush();
after theprint b[NR-30];
. Maybe the output is being buffered.
– muru
53 mins ago
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
This works, but form the script I would expect it to work like tail, printing out a previous line as each new line is added to the file. Instead it prints out in spurts of ~70 lines after ~100 lines are added to the file. It does not print the most recent 30 lines, so it's pretty close...
– ridthyself
1 hour ago
@ridthyself if you have GNU awk, try adding a
fflush();
after the print b[NR-30];
. Maybe the output is being buffered.– muru
53 mins ago
@ridthyself if you have GNU awk, try adding a
fflush();
after the print b[NR-30];
. Maybe the output is being buffered.– muru
53 mins ago
add a comment |
This isn't very efficient, because it will re-read the file every two seconds, but will do the job:
watch 'tail -n40 /path/to/file | head -n10'
add a comment |
This isn't very efficient, because it will re-read the file every two seconds, but will do the job:
watch 'tail -n40 /path/to/file | head -n10'
add a comment |
This isn't very efficient, because it will re-read the file every two seconds, but will do the job:
watch 'tail -n40 /path/to/file | head -n10'
This isn't very efficient, because it will re-read the file every two seconds, but will do the job:
watch 'tail -n40 /path/to/file | head -n10'
answered 2 hours ago
l0b0l0b0
28.7k19121249
28.7k19121249
add a comment |
add a comment |
Same as @muru's but using the modulo operator instead of storing and deleting:
tail -fn+1 some/file | awk -v n=30 '
NR > n {print s[NR % n]}
{s[NR % n] = $0}
END{for (i = NR - n + 1; i <= NR; i++) print s[i % n]}'
add a comment |
Same as @muru's but using the modulo operator instead of storing and deleting:
tail -fn+1 some/file | awk -v n=30 '
NR > n {print s[NR % n]}
{s[NR % n] = $0}
END{for (i = NR - n + 1; i <= NR; i++) print s[i % n]}'
add a comment |
Same as @muru's but using the modulo operator instead of storing and deleting:
tail -fn+1 some/file | awk -v n=30 '
NR > n {print s[NR % n]}
{s[NR % n] = $0}
END{for (i = NR - n + 1; i <= NR; i++) print s[i % n]}'
Same as @muru's but using the modulo operator instead of storing and deleting:
tail -fn+1 some/file | awk -v n=30 '
NR > n {print s[NR % n]}
{s[NR % n] = $0}
END{for (i = NR - n + 1; i <= NR; i++) print s[i % n]}'
answered just now
Stéphane ChazelasStéphane Chazelas
312k57592948
312k57592948
add a comment |
add a comment |
ridthyself is a new contributor. Be nice, and check out our Code of Conduct.
ridthyself is a new contributor. Be nice, and check out our Code of Conduct.
ridthyself is a new contributor. Be nice, and check out our Code of Conduct.
ridthyself is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f510178%2fusing-tail-to-follow-a-file-without-displaying-the-most-recent-lines%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown