Vim can work on 120 million line files that total 5 gigabytes
Literally any other editor starts to fucking up with less than 1 million lines. Meanwhile I can run through all of my server logs like it's a fucking cakewalk
Can your editor do this?
Vim can work on 120 million line files that total 5 gigabytes
Ryan Gomez
Other urls found in this thread:
github.com
scintilla.org
jenson.in
onlinehexeditor.com
twitter.com
Jayden Murphy
Why would I use a text editor to look through server logs?
Nathan Ward
Also vim shits itself as soon as a line gets too long
John Roberts
fuck vim; for logs? cat & grep much?
Liam Wood
Emacs works on petabytes. Of course, there aren't really any situations where that's practical, you're better off map reducing the file first for what you're interested in.
Jackson Gutierrez
For quick analysis
Not as useful sometimes. We had millions of lines from my iptables after an attack. We didn't have any sort automated tool yet. So I had to do some manual preprocessing. Didn't take to long to look through that many lines. Less than an hour
How big are your lines? 22 million and still working well
Thomas Sullivan
>total 5 gigabytes
>Vimfag thinks this is impressive, like a 3 in penis
Emacs works on terabyte files and up github.com
Oliver Reed
>do some manual preprocessing
Like what? Can't imagine it isn't something you can't do with awk,tr or sed.
Oliver Torres
Actually that's 2.5 million lines
I couldn't get emacs to copy more than 300k lines, so I couldn't even get to that point
>hurr durr all you gotta do is add a plugin
Thanks for letting me know I can do something that I could already do in vim natively
Mason Howard
>I could already do in vim natively
Have you tried opening a 8 TB file in Vim?
James Baker
Less is more lightweight for large files and just as good. Also fits better in a pipeline.
It weirds me out when I'm on windows and realize I have no fucking idea how to deal with large text files. I guess besides installing cygwin or something
Xavier Gray
>120 million line files that total 5 gigabytes
I don't write bloat.
Hudson Mitchell
>neovim
>fish
Is this post satire?
Elijah Garcia
I'll give you an example that I had to do. Typically the way I set my iptables. the log comes out like this
Apr 20 15:52:32 Server kernel: [IPTABLES OUT] IN= OUT=eth0 SRC=xxx.xxx.xxx.xxx DST=xxx.xxx.xxx.xxx LEN=73 TOS=0x00 PREC=0x00 TTL=64 ID=22431 DF PROTO=UDP SPT=42412 DPT=53 LEN=53
Apr 20 15:53:29 Server kernel: [IPTABLES IN] IN=eth0 OUT= MAC=xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx SRC=xxx.xxx.xxx.xxx DST=xxx.xxx.xxx.xxx LEN=60 TOS=0x00 PREC=0x00 TTL=243 ID=54321 PROTO=UDP SPT=41985 DPT=53 LEN=40
I could probably have done this with awk/grep. But the way I did it was made them into two files, one for out, one for in. And I used Vim's powerful tools to convert it into something like
IP=xxx.xxx.xxx.xxx PROTO=UDP DPT=53
IP=xxx.xxx.xxx.xxx PROTO=UDP DPT=53
I don't need to do this that often, so I haven't made a script for it. But in vim, it's something like
:%g/IPTABLES OUT/d
gg Ctrl+v G /SRC (Enter) bd
:%s/DST.*PROTO/PROTO
:%s/SPT=\d*/d
:%s/LEN.*/d
It could be a little more optimized. But it works fast enough so I don't really need a script yet
Blake Brown
Pretty colors, but vim is pretty cool desu. I only use it as a text editor though.
> code
> press [esc]
> use mouse, laptop mousepad, or arrow keys to navigate lines
> press [i] again
Juan Walker
wait. no /d for the last two
Ian Davis
vim is pretty good, I agree with OP on that.
It's not a religion though. You need Jesus, user. Put your eagerness and tendency towards blind allegiance to good use and join the priesthood.
Brody Wilson
vim fucks up for me when the file is in 1 line and the text is getting wrapped
Brody Myers
:^)
:set nowrap
Jason Lee
user I don't work with files that big
Gavin Young
Ryan Davis
wow babby discovers editor with memory management.
Thomas Torres
There is no reason why 120million lines should ever be inside any file.
The file needs to be split once it reaches minimum 50k lines.
Caleb Wilson
t. winbabby
You realize that it's not unheard of in some fields to work with files with text contents that are >1TB uncompressed? You can still work fine at that scale if you keep things simple, zgrep works pretty well. Your rule of thumb would result in exploding his relatively small file into 2400 files for no reason, what an improvement.
Evan Morgan
>Add any sort of autocomplete, style checking, auto reloading, etc and vim can't even do a million
Other editors can't fucking do it because they're not stripped down, and I use vim, just not when I have to work on any major projects that require that shit to even be productive.
Carson Brooks
I've never used Vim so I tested it today.I have a 2.5mil line 800MB file text file. It used 1GB ram in Vim. Is that default behavior or do these people have shitloads of ram?
Owen Howard
ed
Kayden Morris
Go through vimtutor.
Matthew Allen
I can literally do it in a browser
jenson.in
onlinehexeditor.com
Michael Smith
>I used Vim's powerful tools
You could do this with a sed one-liner
Jackson Bell
Too bad Vim doesn't let you edit compressed files like Emacs does. Fixing a file inside a zip without having to decompress and recompress is useful.
Nolan Jones
Not him but if I ever saw a 8 TB text file anywhere, I would kill the person who made it, the developer of the program that created it and whoever configured the server it was found on.
As in, actually murder them.
Sebastian Gutierrez
8 TB is nothing in big data. If you have an 8 TB drive just filled with data and unpartitioned, it's basically an 8 TB file (you just open /dev/sdx as a file), and it's going to be in some structured format. It probably won't be completely ASCII and you probably aren't going to use a text editor on it, but being able to do so in a pinch is handy. Emacs can work with binary files too, so...
Liam King
Found the ReiserFS dev.
Sebastian Hill
Typical linux user. Suck on a chode
Jackson Powell
Try out spacevim. That's how I have my editor looking like that. And it provides auto complete to a bunch of stuff
Tyler Edwards
If you're at that point, you might as well make the python/perl script that will run through the file for you.
I do wonder how well it'll work if you try to delete the first few words of each line with evil mode. Probably not well
Carter Bennett
Yes, vim is great! If only it was usable by sane, self-respecting users from this century.
My software works for me, not the other way around.
Asher Phillips
Only things I got from this thread is I should install emacs.
Robert Harris
There is a very large file mode for emacs
Easton Howard
Unless it's all other Linux stuff, in which case I'll masochistically eat shit nonstop because there's no superior alternative.
Michael Jones
That's nothing, one time I opened a 600 million line file in mousepad that was 25 gigabytes
Nicholas Adams
>Also fits better in a pipeline.
no but more does
Aiden Lee
>120 million line files that total 5 gigabytes
are you a GNOME dev?
Noah Long
for you
William Barnes
A-user, can I see your collection of N-Nicole's reactions?
Colton Morgan
Emacs kiddo
Alexander Ward
Why does your vim look so weird? It's supposed to run in a terminal
Joshua Scott
Julian Harris
>serverlogs are a single file instead of multiple properly named files
it speaks worlds about how retarded the logging system is
Sebastian Young
Of course it can, since I also use Vim.
Nathan Adams
Does YOUR editor cost $80? I didn't think so.
Michael Sanchez
i want to see them too
Jordan Ward
>he paid for software
LMAOO this actually happens?
Cooper Brown
nano
Adrian Rogers
Um, no, sweetie. And it's properly graphical unlike that terminal escape code abortion
Asher Gutierrez
>hackintosh
>plan9 editor
Aiden Allen
>120 million line files that total 5 gigabytes
IT WILL LOAD AND SAVE TERRIBLE LONG
MIDTIGHT_COMMANDER AND FAR_MANADGER CAN WORK WITH 25 gigabytes AND DONT HAVE KINE COUNT LIMITATION
Evan Robinson
I don't think you have the bandwidth.
Samuel White
have you tried most?
Angel Cooper
bruh, I am the bandwidth
Nolan Scott
> Why settle for less?
heh but no i havent
Caleb Lewis
i don't think so
Adrian Wilson
It's my favourite pager
pros:
>sensible shortcuts
>can open multiple files
>can split screen
cons:
>non standard shortcuts
>may not be available in your distribution