Synchronization Upload quota issue on "bigger" files

Here you can discuss the universal Integrated Development Environment for OpenVMS
Post Reply

Topic author
cgoodwin
Contributor
Posts: 13
Joined: Wed Aug 21, 2019 8:43 am
Reputation: 0
Status: Offline

Synchronization Upload quota issue on "bigger" files

Post by cgoodwin » Wed Oct 16, 2019 4:34 pm

I have been synchronizing, building and debugging files using the VMS IDE for the past couple weeks and things have been working well. Recently however, I synchronized one of our larger Fortran files (over 3000 lines). Synchronizing it locally seemed to work ok, I made the edits, then synchronized it back to VMS. The output log said that the upload of that file was successful. When I went to build, it failed. VS Code also gave me a waarning saying that it got truncated after 7200 characters. Upon further investigation, it appeared that the build was only trying to build code from the first third of the file. I went into VMS and did a type command on the code file, and after outputting the first third of the code file, it errored out with the following message:

Code: Select all

%TYPE-F-WRITEERR, error writing SYS$OUTPUT:.;
-RMS-F-SYS, QIO system service request failed
-SYSTEM-F-EXQUOTA, process quota exceeded
Doing a type command on the previous version of the file (before any synchronizations), successfully outputs the full file. I deleted the most recent version on both VMS and locally then added some text to the end of the file, synchronized again, did my type command and had the same issue. I did this same test, except I removed text from the code file instead of adding text, and still got the same results. What could cause this issue?


sergey_vorfolomeev
VSI Expert
Contributor
Posts: 19
Joined: Thu Aug 22, 2019 12:17 am
Reputation: 0
Status: Offline

Re: Synchronization Upload quota issue on "bigger" files

Post by sergey_vorfolomeev » Fri Oct 18, 2019 4:26 am

We are unable to reproduce the problem using considerably larger files. The problem could be related to a quota issue (BYTLM for example). What happens if you try sftp’ing the file manually?


Topic author
cgoodwin
Contributor
Posts: 13
Joined: Wed Aug 21, 2019 8:43 am
Reputation: 0
Status: Offline

Re: Synchronization Upload quota issue on "bigger" files

Post by cgoodwin » Fri Oct 18, 2019 12:34 pm

The file is ok when I sftp it, just when I use the VMS IDE Sync functionalities is when the issue occurs.


brianreiter
Contributor
Posts: 16
Joined: Fri Jun 14, 2019 4:17 pm
Reputation: 0
Status: Offline

Re: Synchronization Upload quota issue on "bigger" files

Post by brianreiter » Mon Oct 21, 2019 4:40 am

Have you a look at the file? DIR/FULL or a DUMP/REC?

I've had that error in the past when FTP/SFTP have done something to the file format. Something akin to what we get when text files are uploaded as binary using FTP.

Might be worthwhile doing a DIFF between what gets uploaded and the previous version,


Topic author
cgoodwin
Contributor
Posts: 13
Joined: Wed Aug 21, 2019 8:43 am
Reputation: 0
Status: Offline

Re: Synchronization Upload quota issue on "bigger" files

Post by cgoodwin » Mon Oct 21, 2019 11:56 am

I did have a look at the both the previous version compared to the uploaded version of a dir/full for the file and there is no difference. Doing a dump/rec and viewing the results, it ends prematurely with a bunch of '.'s.

When I did a DIFF it fails prematurely with the following error (at the same place it fails on the type, dump and edit):
%DIFF-F-READERR, error reading file_name
-RMS-W-RTB, 25711 byte record too large for user's buffer

Added in 1 hour 20 minutes 5 seconds:
As a small update, I synced the original file locally using Filezilla, renamed the file, added it to the project, then synced it back up with VMS. This did work, so the problem must be with the initial sync down.

Added in 22 minutes :
An even stranger result just came from a second test I just performed. After my previous test, I deleted my local copies, and resynced with VMS. This pulled down:
- The original
- The version I renamed from my previous test.
I added a new line to both, resynchded them both to VMS, then checked them on VMS. The renamed file works!
As another interesting bit, since this uploads a new version of the original, I decided to wipe my local files again and sync with VMS an additional time. The new version of the original that synced had a bunch of scrambled characters where it would error out on VMS (it looks like a binary encoding). Is there a possibility that part of the file could be getting a binary encoding when being synced for any reason?
Last edited by cgoodwin on Mon Oct 21, 2019 1:43 pm, edited 2 times in total.


sergey_vorfolomeev
VSI Expert
Contributor
Posts: 19
Joined: Thu Aug 22, 2019 12:17 am
Reputation: 0
Status: Offline

Re: Synchronization Upload quota issue on "bigger" files

Post by sergey_vorfolomeev » Tue Oct 22, 2019 12:48 am

What type of synchronization did you use? "downloadNewFiles":
https://wiki.vmssoftware.com/Synchronize_Configuration


Topic author
cgoodwin
Contributor
Posts: 13
Joined: Wed Aug 21, 2019 8:43 am
Reputation: 0
Status: Offline

Re: Synchronization Upload quota issue on "bigger" files

Post by cgoodwin » Tue Oct 22, 2019 9:24 am

sergey_vorfolomeev wrote:
Tue Oct 22, 2019 12:48 am
What type of synchronization did you use? "downloadNewFiles":
https://wiki.vmssoftware.com/Synchronize_Configuration
I always used overwrite.

Post Reply