Very slow on large files

[dardoor]

I'm trying the latest version and it's still pretty much unusable on large files (and by "large files" I mean like 10MB).
It can make N++ hang maybe for hours and it's not even possible to cancel the compare process. I don't know if it's the size alone or the number of lines that causes this.

If it's not possible to fix this, maybe you can add a warning when a user tries to compare large files.

[pnedev]

What is actually "the latest" version you are using ? ComparePlus 1.1.0 ?

Are the files confidential ? If they are not, could you upload them here or share them so I can analyze what is happening ?

BR

[dardoor]

Yes, version 1.1.0.
Here are two files I can share: https://www.sendspace.com/file/gdaiau
I've had some worse examples too, where N++ was stuck for over an hour. But I can't find them right now and it is possible that it was with an older version of the plugin.

[pnedev]

Hello @dardoor ,

Thank you for the example files.
These are really big binary files with lots of long lines and a lot of differences which causes such long compare time.
I believe other compare tools/programs will also have troubles comparing them and will also take considerable time doing so.
Unfortunately this cannot be avoided, ComparePlus plugin is aimed at comparing mainly shorter text files or bigger files that do not differ a lot.
Your idea about the warning before comparing such file types is really good and I will also fix the Cancel functionality to be more responsive in such cases.

BR

[dardoor]

Thanks.

I believe other compare tools/programs will also have troubles comparing them and will also take considerable time doing so.

Some programs can compare them instantly. For example Total Commander (select both files and then Files->Compare By Content...). It can show them as binary or as text lines like in N++. It just doesn't look as nice as in N++ with your plugin.

And WinMerge is free, looks nice and is very fast too. https://winmerge.org/

I think some of the slowness here is also the fault of N++ itself, which takes a while to open big files even when not comparing.

[pnedev]

Hello @dardoor ,

Some programs can compare them instantly.

Interesting.
Anyway, I don't think I can do much about making ComparePlus faster when comparing such files, sorry.
I'll improve the Cancel responsiveness and add a warning before starting the compare process for large files.
Thank once again.

BR

[pnedev]

Hello @dardoor ,

I have made Cancel much more responsive and added a warning message before comparing very large files.
The changes will be included in the next release but meanwhile you can get the dev build from here: win32 , win64 or arm64. The dev builds are for Notepad++ versions >= 8.4.7.

P.S. About slow responsiveness of Notepad++ when dealing with large files - if you haven't done that already disabling Word Wrap function could speed things up significantly.

BR

[Yaron10]

Hello Pavel,

Thank you very much for the recent improvements. 👍

Comparing the files @dardoor provided in #339 (comment), and pressing Cancel after ~2 seconds - NPP still hangs on my machine. Isn't that the case on yours?

BR

[pnedev]

Hello Yaron,

Thank you for testing this.
I don't see a considerable delay after pressing Cancel and the actual compare cancel. No more than 2 seconds (even less).
Most of the time it is almost instant. I tried in different moments after starting compare on the example files provided by @dardoor.
What exactly do you observe? By "NPP hangs" do you mean that you see the progress message "Cancelling compare, please wait..." but you wait very long time before operation is cancelled or it is not cancelled at all?

My change might depend on the computer speed so is your computer processor older generation?

Thanks and BR

[Yaron10]

Hello Pavel,

On Cancel:

Before the recent commits:
I get a black screen with the title "Not responding".
The progress message remains on that black screen until I press the Close button.
After pressing the Close button, I get the Windows message "Notepad++ is not responding...".

With the latest commit:
I get a black screen with the title "Not responding".
The progress message disappears almost instantly. 👍
After pressing the Close button, I get the Windows message "Notepad++ is not responding...".

So there's certainly some improvement, but NPP still hangs/crashes.

I've tested it on a relatively powerful PC.

Thank you again.

BR

[pnedev]

Hello Yaron,

That is totally not what I was expecting :))

Well, then my fix works OK - the progress disappears almost instantly meaning that compare has been cancelled but the black screen is something new to me and might be either another bug or most probably NPP related behavior itself.

Do you see that black screen when you open the files initially?
Have you tried waiting some time before closing NPP?
Could you please try the same but make sure that 'Word Wrap' is disabled (if it has been enabled in your previous tests)?
Could you also try removing all other plugins just to make sure they are not interfering?
I did my tests on NPP 8.4.7 and 8.4.8, I suppose you are using one of those versions too (unaltered in any way).

Thank you very much! 👍

BR

[Yaron10]

Hello Pavel,

Well, then my fix works OK - the progress disappears almost instantly meaning that compare has been cancelled but the black screen is something new to me and might be either another bug or most probably NPP related behavior itself.

👍

Could you please try the same but make sure that 'Word Wrap' is disabled (if it has been enabled in your previous tests)?

👍
I occasionally get a black screen (without the "Not responding" in the title) for a split second, but then the Compare is canceled and everything is OK.

I did my tests on NPP 8.4.7 and 8.4.8, I suppose you are using one of those versions too (unaltered in any way).

8.4.8. Unaltered in any way. :)

Could you also try removing all other plugins just to make sure they are not interfering?

I've removed all other plugins. Same results.

Do you see that black screen when you open the files initially?

Interesting.
When I first open the files (by d&d or from the Recent Files), I do not get the black screen. Word wrap ON or OFF.
But if start Compare with Word wrap unchecked, Cancel, close the files, check Word wrap and then open the files from the Recent Files - I do get the black screen.

Have you tried waiting some time before closing NPP?

With Word wrap ON -
I have waited for some 10 seconds. No change.
Don't you get the black screen on your machine? Wine?

Thank you maestro. I appreciate your work. 👍

BR