This is www.gnqs.org, The Home Of Batch Processing


Home | Developers | Documents | Downloads | Mailing Lists | People | Support | Volunteer


Changes To Monsanto-NQS 3.37.0

Academic Computing Services , University of Sheffield

Stuart Herbert S.Herbert@Sheffield.ac.uk

Document copyright ©. All rights reserved.


Abstract

The University of Sheffield is supplying, and supporting, Monsanto NQS to UK Higher Educational sites as part of the New Technologies Initiative of JISC. This document contains a summary of changes for each new release of NQS.


Contents

Click here for a plain-text version of this paper. Click here for a copy of this document in Microsoft RTF format, suitable for printing (if available).

Changes


Introduction

This is a summary of the changes to Monsanto NQS as released by the Univesity of Sheffield.

We are most grateful for the contributions made by other individuals and/or organisations.


Version 3.37

This is the last release of the product under the name `Monsanto-NQS'. The next release will be the first beta release of a POSIX.1-compliant source tree, and will be numbered v3.50. The new name of this product has not yet been decided. The v3.50 beta release will be announced on the `NQS-Developers' mailing list, as normal.


Native 64-bit IRIX Support

The makefile ./proto/Makefile.sgi6.64 can be used to compile a native 64-bit version of Monsanto-NQS.

The makefile ./proto/Makefile.sgi6 still produces 32-bit binaries for IRIX 6. It is likely that this option will be removed at some point in the future. At the minute, I don't know what the issues are, and so it stays.

> [ ] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [x] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Thomas Ziehmer


Modified Makefiles

For the first time, the file ./proto/Makefile is now supplied. Edit this file to specify the NQS directories to install into, and then uncomment the correct line at the end of ./proto/Makefile to include the correct Makefile for your platform.

The INSTALL file has been updated accordingly.

All platforms are affected.

Thomas Eifert & Stu


Version 3.36.7

NOTE: This version was only released for testing purposes.


HPUX 8 Support Improved

You can now use the makefile ./proto/Makefile.hpux8 to ensure successful compilation on HPUX-8.

To help distinguish between the two, the HPUX-9 specific makefile has been moved to ./proto/Makefile.hpux9.

Stuart, with thanks to Brian M Bullen (b.m.bullen@stir.ac.uk) and Michael Shepard (michaels@jake.cem.unsw.edu.au)


IRIX 5 Support Improved

IRIX 5 and IRIX 6 now share the same code for using /proc - previously IRIX 5 used /dev/kmem where IRIX 6 used /proc. This code hasn't been tested on IRIX 6 yet, but appears to work fine on IRIX 5.

> [ ] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [x] IRIX 5			> [x] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Stu


AIX Compiler Drivers

The compiler for IBM RS/6000 based systems by default allocates very large amounts of data segment space, whether it is required or not. This interferes with ongoing work to provide a proper scheduler for NQS.

Inside the directory ./rzxl, you will find new drivers, plus a comprehensive README and full installation instructions.

> [x] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [ ] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Thomas Eifert (Eifert@reze-1.rz.rwth-aachen.de)


Non-ANSI Compilers Detected

I've added a couple of lines of code which will ensure that using a non-ANSI C compiler to compile Monsanto-NQS will result in an error in ./h/hqs.h. This makes it easier for me to determine when to advise a site to upgrade their compiler (perhaps to GNU C).

> [ ] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [ ] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [x] SUNOS 4			> [x] ULTRIX 
Stuart


OSF/1 SIGSEGV Fixes

OSF/1 would segmentation fault when attempting to print out a machine ID (as assigned by nmapmgr) during boot up (when generating error messages about being unable to determine the local mid). Fixed.

NOTE: There may be more of these which I've not found yet, at other stages of NQS.

> [ ] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [ ] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [x] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Stu


AIX Nice Values

AIX now correctly uses the BSD interface to setting nice values for jobs.

> [x] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [ ] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Stu


Environment Variable Fixes

When constructing environments for child processes, NQS was failing to correctly count the length of some of the strings in the environment. Fixed.

NOTE: There may be more of these errors in NQS which I've not yet uncovered.

> [x] AIX			> [x] HPUX 8 
> [x] HPUX 9			> [x] IRIX 4 
> [x] IRIX 5			> [x] IRIX 6 
> [x] LINUX			> [x] NCR 
> [ ] OSF/1			> [x] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Thomas Ziehmer


Debugging Patches

Extra debugging information (available when the DEBUG level is set to 5 or more using qmgr(1)) is now available, to assist in tracking down initial problems.

In addition, the error reporting code in qsub was ambiguious - this has been changed.

All platforms affected, but the code is aimed at tracking current problems with OSF/1 3.2.

Stuart Herbert (S.Herbert@sheffield.ac.uk)


qstat Output Modified

Sequence number fields are now five characters long instead of the original four.

All platforms affected.

Stu


Linux Support For FSSTND

I've modified Makefile.linux so that binaries should be installed into directories under /usr/local. This should make installation more compliant with the Linux FSSTND.

> [ ] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [ ] IRIX 6 
> [x] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Stu


IRIX 6 Compilation Error Fixed

Makefile.sgi6 had a missing `-L.' on the LINKLIBS line, which meant that the linker on IRIX 6 was unable to find the .a files in the ./proto directory. Fixed.

> [ ] AIX			> [ ] HPUX 8 
> [ ] HPUX 9			> [ ] IRIX 4 
> [ ] IRIX 5			> [x] IRIX 6 
> [ ] LINUX			> [ ] NCR 
> [ ] OSF/1			> [ ] SOLARIS 2 
> [ ] SUNOS 4			> [ ] ULTRIX 
Stu


Version 3.36.6


Support For NCR UNIX (AT&T)

Monsanto-NQS now works on AT&T GIS (NCR) SVR4. Use the makefile ./proto/Makefile.ncr for compiling.

NOTE that the NCR C compiler fails to compile Monsanto-NQS - you must use GCC instead (GCC 2.6.3 was used in this case).

> [ ] AIX			> [ ] HPUX 
> [ ] IRIX 4			> [ ] IRIX 5 
> [ ] IRIX 6			> [ ] LINUX 
> [x] NCR			> [ ] OSF/1 
> [ ] SOLARIS 2			> [ ] SUNOS 4 
> [ ] ULTRIX 
Norm Rullo (normr@accelr8.com)


Support For OSF/1 v3.0

Monsanto-NQS now works on OSF/1 v3.0. Use the makefile ./proto/Makefile.decosf for compiling.

> [ ] AIX			> [ ] HPUX 
> [ ] IRIX 4			> [ ] IRIX 5 
> [ ] IRIX 6			> [ ] LINUX 
> [ ] NCR			> [x] OSF/1 
> [ ] SOLARIS 2			> [ ] SUNOS 4 
> [ ] ULTRIX 
Dan Rugotzke (rugotzke@nevada.edu)


More HPUX Fixes

The HPUX fixes included in v3.36.5 were not complete, and have now been fixed.

> [ ] AIX			> [x] HPUX 
> [ ] IRIX 4			> [ ] IRIX 5 
> [ ] IRIX 6			> [ ] LINUX 
> [ ] NCR			> [ ] OSF/1 
> [ ] SOLARIS 2			> [ ] SUNOS 4 
> [ ] ULTRIX 
Norm Rullo (normr@accelr8.com)


Solaris 2.1 Work-Around

On Solaris 2.1, getservbyname() doesn't accept NULL as the second parameter - this has been changed.

> [ ] AIX			> [ ] HPUX 
> [ ] IRIX 4			> [ ] IRIX 5 
> [ ] IRIX 6			> [ ] LINUX 
> [ ] NCR			> [ ] OSF/1 
> [x] SOLARIS 2			> [ ] SUNOS 4 
> [ ] ULTRIX 
Norm Rullo (normr@accelr8.com)


CPU Limits Enforced On IRIX 5/6

IRIX 5 and IRIX 6 systems by default ignore the signals associated with CPU time limits being exceeded - the signal handling has been updated to ensure these signals are no longer ignored.

> [ ] AIX			> [ ] HPUX 
> [ ] IRIX 4			> [x] IRIX 5 
> [x] IRIX 6			> [ ] LINUX 
> [ ] NCR			> [ ] OSF/1 
> [ ] SOLARIS 2			> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart, with thanks to Kristian Wedberg (wedberg@mednet.gu.se)


OSF/1 Compilation Failure Fixed

Compilation of Monsanto-NQS v3.36.5 was reported to fail on OSF/1 v2.0, partially because of an error in the HPUX code in v3.36.5, partially because of the ANSI prototypes, and partly because of a missing #include statement.

The OSF/1 Makefile has been changed to include the `-std1' switch, which I understand will fix the problems with the ANSI prototypes. The HPUX code (see above) has also been fixed.

> [ ] AIX			> [ ] HPUX 
> [ ] IRIX 4			> [ ] IRIX 5 
> [ ] IRIX 6			> [ ] LINUX 
> [ ] NCR			> [x] OSF/1 
> [ ] SOLARIS 2			> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart, with thanks to Norm Rullo (normr@accelr8.com)


Formal Bug-List Included

From now on, each new release of Monsanto-NQS will include detailed information on all reported problems which are still outstanding.

The latest version (updated daily) will always be available via the World Wide Web :

(More information can be found at :)

> http://www.shef.ac.uk/uni/projects/nqs/html/Monsanto-bugs.contents.html 
or in plain ASCII text via ftp :

(More information can be found at :)

> http://www.shef.ac.uk/pub/uni/projects/nqs/doc/Monsanto-bugs.txt 
Stuart


Debugging Code Added

I am investigating a reported routing problem on SunOS 4. Code has been added to the nmap database library to produce extra debugging information in an attempt to discover more about this problem.

> [x] AIX			> [x] HPUX 
> [x] IRIX 4			> [x] IRIX 5 
> [x] IRIX 6			> [x] LINUX 
> [x] NCR			> [x] OSF/1 
> [x] SOLARIS 2			> [x] SUNOS 4 
> [x] ULTRIX 
Stuart


Version 3.36.5


Solaris 2 Cluster Fix

A bug in the Solaris 2-specific code in the libnmap was causing requests between machines to fail. This bug has now been fixed.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [ ] IRIX 6 
> [ ] LINUX 
> [ ] OSF/1 
> [x] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart, with thanks to John Roman of Monsanto.


HPUX Process Stats Fix

The call to pstat() in ./lib/shoqbydesc.c has (hopefully) been fixed.

> [ ] AIX 
> [x] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [ ] IRIX 6 
> [ ] LINUX 
> [ ] OSF/1 
> [ ] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart, with thanks to the University of Liverpool, and the University of Queens-Belfast.


SunOS & Solaris Process Stats

Code has been added for displaying extended information by using the qstat(1) command.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [ ] IRIX 6 
> [ ] LINUX 
> [ ] OSF/1 
> [x] SOLARIS 2 
> [x] SUNOS 4 
> [ ] ULTRIX 
Bill Ralph (wdralph@nwer.sandia.gov)


Linux Makefile Added

Somehow, the source code at work (Solaris 2) didn't include a makefile for Linux - I do all my Linux testing at home. The Linux makefile has now been added to the distribution.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [ ] IRIX 6 
> [x] LINUX 
> [ ] OSF/1 
> [ ] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart


OSF/1 2.0 Support

Monsanto-NQS now compiles and runs on v2.0 of OSF/1.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [ ] IRIX 6 
> [ ] LINUX 
> [x] OSF/1 
> [ ] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart, with thanks to Norm Rullo (normr@accelr8.com)


Version 3.36.4

Please note that the new, IRIX 6.0 stuff, has not been tested by me, simply because I don't have access to IRIX 6.

This release has successfully compiled and executed on Solaris 2.3 and Linux 1.1.53.

Stuart


IRIX 6.0 Support & ANSI Prototypes

Monsanto-NQS now compiles and runs on SGI's IRIX 6.0 release. As a side effect of this, all code now has ANSI-style declarations. Sites running SunOS 4 must either use `acc' or GNU's `gcc' compiler to compile NQS from now on.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [x] IRIX 6 
> [ ] LINUX 
> [ ] OSF/1 
> [ ] SOLARIS 2 
> [x] SUNOS 4 
> [ ] ULTRIX 
Dave Safford (d-safford@tamu.edu)


Processor Set Support

IRIX allows quite a variation in the configuration of its multiple processor hosts using the `pset' command. Support for processor sets is available for IRIX 6.0 right now, thanks to Dave - I'll make it available to IRIX 5 users once I've had the opportunity to test it.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [x] IRIX 5 
> [x] IRIX 6 
> [ ] LINUX 
> [ ] OSF/1 
> [ ] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Dave Safford (d-safford@tamu.edu)


qacct(1) Patched

The new `-m' switch of qacct can be used to show when a request was submitted. Temporary files are now created in /usr/adm, rather than /usr/tmp, before renaming.

> [x] AIX 
> [x] HPUX 
> [x] IRIX 4 
> [x] IRIX 5 
> [x] IRIX 6 
> [x] LINUX 
> [x] OSF/1 
> [x] SOLARIS 2 
> [x] SUNOS 4 
> [x] ULTRIX 
John Roman (jrroma@beaker.monsanto.com)


Quota support fixed

The code which examined the file systems quota has been patched.

> [x] AIX 
> [x] HPUX 
> [x] IRIX 4 
> [x] IRIX 5 
> [x] IRIX 6 
> [x] LINUX 
> [x] OSF/1 
> [x] SOLARIS 2 
> [x] SUNOS 4 
> [x ] ULTRIX 
John Roman (jrroma@beaker.monsanto.com)


Version 3.36.3


Bug In qacct(1)

An internal copying error in qacct(1) has been rectified.

> [x] AIX 
> [x] HPUX 
> [x] IRIX 4 
> [x] IRIX 5 
> [x] LINUX 
> [x] OSF/1 
> [x] SOLARIS 2 
> [x] SUNOS 4 
> [x] ULTRIX 
Stuart, thanks to Michael Hamilton (hamiltom@ecnz.co.nz)


Version 3.36.2


New OS Supported : Linux

NQS now compiles and runs on Linux. Tested on Linux 1.1.54 with gcc v2.2.58, although I can't see any reason why it should not work on any standard Slackware distribution running a 1.0.x Linux kernel.

NOTE that because Linux lacks a plock() call, the NQS daemon cannot be locked in memory from qmgr(1m). Otherwise, all the functionality of NQS is available on Linux.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [x] LINUX 
> [ ] OSF/1 
> [ ] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart, based on work by Dr. Karsten Steffens (karsten@kshome.ruhr.de)


Version 3.36.1


Compilation Problem

nqs_reqser.c has had two lines of code split into more lines to work around an apparent compiler problem on Solaris 2.3.

> [ ] AIX 
> [ ] HPUX 
> [ ] IRIX 4 
> [ ] IRIX 5 
> [ ] OSF/1 
> [x] SOLARIS 2 
> [ ] SUNOS 4 
> [ ] ULTRIX 
Stuart


Compilation Problem

The makefile has been altered to link against libnqs.a and libnmap.a using `-lnqs.a' and `-lnmap.a'.

> [x] AIX 
> [x] HPUX 
> [x] IRIX 4 
> [x] IRIX 5 
> [x] OSF/1 
> [x] SOLARIS 2 
> [x] SUNOS 4 
> [x] ULTRIX 
Stuart


Credits


Credits and Acknowledgements

The following people have contributed to the continued maintenance of Monsanto-NQS :

> Brian Bullen		b.m.bullen@stir.ac.uk 
> Thomas Eifert		Eifert@reze-1.rz.rwth-aachen.de 
> Michael Hamilton	hamiltom@ecnz.co.nz 
> Stuart Herbert	S.Herbert@Sheffield.ac.uk	NQS Maintainer 
> Bill Ralph		wdralph@nwer.sandia.gov 
> John Roman		jrroma@albert.monsanto.com	Original author 
> Dan Rugotzke		Rugotzke@nevada.edu 
> Norm Rullo		normr@accelr8.com 
> Dave Safford		d-safford@tamu.edu 
> Karsten Steffens	karsten@kshome.ruhr.de 
> Kristian Wedberg	Wedberg@mednet.gu.se 

Automagically produced by KTEpaper, part of The Knowledge Tree Engine

This site (www.gnqs.org) is copyrighted. You can view the terms & conditions here.
You can contact the webmaster here.



Please address all correspondance about this page to

This site (www.gnqs.org) is copyrighted. You can view the terms & conditions here.
You can contact the webmaster here.



Please address all correspondance about this page to

This site (www.gnqs.org) is copyrighted. You can view the terms & conditions here.
You can contact the webmaster here.



Please address all correspondance about this page to

This site (www.gnqs.org) is copyrighted. You can view the terms & conditions here.
You can contact the webmaster here.