[Savannah-cvs] [634] partially update info on cron jobs

[ineiev]

Revision: 634
          
http://svn.savannah.gnu.org/viewvc/?view=rev&root=administration&revision=634
Author:   ineiev
Date:     2023-06-13 08:28:57 -0400 (Tue, 13 Jun 2023)
Log Message:
-----------
partially update info on cron jobs

Modified Paths:
--------------
    trunk/sviki/SavannahInternals.mdwn

Modified: trunk/sviki/SavannahInternals.mdwn
===================================================================
--- trunk/sviki/SavannahInternals.mdwn  2023-06-13 11:31:35 UTC (rev 633)
+++ trunk/sviki/SavannahInternals.mdwn  2023-06-13 12:28:57 UTC (rev 634)
@@ -328,16 +328,12 @@
     */10 * * * *    root    nice -n 11 sv_aliases --cron && sed -e '/# 
Savannah include start/,/# Savannah include end/s/\([^:]\+\): .*/\1: 
INVALID.NOREPLY@gnu.org/' /etc/email-addresses -e 's,This is 
/etc/email-addresses,DO NOT EDIT - GENERATED FROM email-addresses.,' > 
/etc/email-addresses_SENDER
 
     # remake list of git repositories in each group.
-    */15 * * * *       root    nice -n 11 
/usr/src/infra/git/refresh-project-list.sh && /usr/src/infra/git/sv_cgit.pl
+    */15 * * * *       root    sv_cgit.pl
 
-    # remake CVSROOT/{commit,log}/info (for cvs commit email).
-    31 * * * * root    nice -n 11 /usr/src/infra/cvs/generate_log_accum.pl
-
     # remake list of groups for the vcs.
     35,05 * * * *      root    nice -n 11 sv_groups --cron --only-cvs 
--only-homepage --only-svn --only-git --only-hg --only-bzr
 
-* 
[/backend/mail/sv_aliases.in](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/mail/sv_aliases.in)
-  (installed in `vcs0:/usr/local/bin/sv_aliases`) - This script prepares an
+* /backend/mail/sv_aliases - This script prepares an
   `alias`-type file for for exim4 mail server, used when sending commit
   updates to mailing lists.
     * The script queries the MySQL database, extracting user names and
@@ -361,52 +357,10 @@
     * FIXME: where is `/etc/email-addresses_SENDER` mentioned/used?
       in an exim4 config file?
 
-* `refresh-project-list.sh` - this script updates the
-  `vcs0:/srv/git/project-list` file which is used by gitweb CGI application.
-    * FIXME: file is `vcs0:/usr/src/infra/git/refresh-project-list.sh`, and
-      is not in the `savane` repository. Add it?
-    * gitweb configuration file is `vcs0:/etc/gitweb.conf`.
-    * Implemetation detail: the script does not re-generate the
-      `project-list` from scratch. Instead, it scans `/srv/git` for new git
-      repositories, and only adds them to the file if they aren't already
-      listed. This allows manually adding information to the `project-list`
-      file, ensuring it will not be overwritten. The manually added
-      information is the owner name/email for some repositories. Example:
-
-            $ cat /srv/git/project-list
-            ...
-            administration.git Savannah+Hackers
-            anubis.git bug-anubis@gnu.org
-            autoconf.git autoconf@gnu.org
-            automake.git automake@gnu.org
-            autostrap.git Sylvain+Beucler
-            coreutils.git Jim+Meyering
-            ...
-
-      These names (e.g. `Jim Meyering`) will appear
-      in the *owner* field when viewing the gitweb page of the group
-      (example: <http://git.savannah.gnu.org/gitweb/?p=coreutils.git>).
-
 * `sv_cgit.pl` - this script updates the `vcs0:/srv/git/cgitrepos` file
   which is used by the cgit CGI application.
-    * FIXME: file is `vcs0:/usr/src/infra/git/sv_cgit.pl` and is not in the
-      `savane` repository. Add it?
     * cgit configuration file is `vcs0:/etc/cgitrc`.
-    * Implementation detail: the script reads the `/srv/git/project-list`
-      file (generated by `refresh-project-list.sh`, above), and for each
-      mentioned group, writes an entry in `cgitrepos`. Example:
 
-
-            $ cat /srv/git/cgitrepos
-            ...
-            repo.group=GNU Core Utilities
-            repo.url=coreutils.git
-            repo.path=/srv/git/coreutils.git
-            repo.desc=GNU coreutils
-            repo.readme=README.html
-            repo.owner=Jim Meyering
-            ...
-
 * `sv_groups` - This script creates new repositories for groups in the
   Savannah database
     * reminder: when a new group is approved on
@@ -413,7 +367,6 @@
       Savannah, or when a group administrator selects a new repository
       feature the `frontend` PHP code only updates the database. this
       script picks up the changes and executes them.
-    * file is 
[/backend/accounts/sv_groups.in](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/accounts/sv_groups.in).
     * The script queries the `groups` table, and creates the needed
       repositories.  
       Example: For group `XXX`, if `groups.use_git=1`, it look for
@@ -433,63 +386,29 @@
       `webcvs` (Using `WebCvMakeAreaSavannahGNU` in `Cvs.pm`) - webcvs
       repository (files will be available on www.gnu.org/www.nongnu.org).
       The same routines also update existing CVS hooks.
-    * The script also contains legacy code to create Unix groups on the
-      local machine (using `/usr/sbin/groupadd`). This part is not used any
-      more, since groups and users are delegated to `nsswitch/libnss-mysql`
-      (see [[UserAuthentication]]).
-    * FIXME: What as "Area Attic" (mentioned in the code)?
     * The script takes parameteres determining which items to create (e.g.
       `--only-git`).
     * On `vcs` host, the git/hg/bzr/cvs/cvsweb repositories are created.
-    * On `download` host, the download (and legacy 'arch') are created.
+    * On `download` host, the download are created.
 
 ### Cron jobs on download
 
 Some cron jobs may still be running on the old download VM still in
 use but now accessible as `olddownload`.  The intent is to have
-everything moved off of there eventually. FIXME: as of 2019-05-07,
-olddownload is down.
+everything moved off of there eventually.
 
 stored in `download0:/etc/cron.d/sv`:
 
-    */30 * * * *       root    sv_groups --cron --only-download --only-arch
+    */30 * * * *       root    sv_groups --cron --only-download
 
-* `sv_groups` - This script creates new repositories for groups in the
+* `sv_groups` - This script creates new repositories for groups listed in the
   Savannah database. See description for `sv_groups` in the above section.
 
 ### Cron jobs on frontend
 
-* `frontend0:/etc/cron.d/sv_export` [non-functional] - contains the
-  following commands:
+Basically, none.  Wiki refresh is run once an hour, but this isn't really
+needed.
 
-        # XML data export
-        02 * * * *      root    sv_export --xml-path /var/cache/savane
-
-        # Remove old data export
-        30 1 * * *      root    sv_export_cleaner --xml-path /var/cache/savane
-
-        # Get list of Git repositories
-        3,33 * * * *    root    scp vcs.sv.gnu.org:/srv/git/cgitrepos 
/etc/savane
-
-  
[sv_export](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/export/sv_export.in)
-  is an old feature which exports group data into XML.  
-  FIXME: remove this?
-
-* `frontend0:/etc/cron.daily/sv_list_groups` [unfinished] - an attempt to
-  publish an authoritative list of active groups hosted on GNU Savannah.
-  The script contains the following code:
-
-        mysql savane -B -e 'SELECT group_type.type_id, group_type.name,
-                                   unix_group_name, group_name
-                            FROM groups, group_type
-                            WHERE groups.type = group_type.type_id
-                                  AND groups.status="A"
-                            ORDER BY type;' \
-                            > /var/www/overlay/cooperation/groups.tsv
-
-  FIXME: complete this nice feature, and expose it with apache
-  configuration. Also possibly with JSON data, and more fields.
-
 ### Cron jobs on mgt0
 
 Stored in `mgt0:/etc/cron.d/sv`:
@@ -517,62 +436,15 @@
   users and groups in the Savannah system.
     * reminder: across all Savannah hosts, Unix user/group ids are managed
       with nsswitch/libnss-mysql (see [[UserAuthentication]] for details).
-    * Source code:
-      
[/backend/accounts/sv_assign_uid_gid.in](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/accounts/sv_assign_uid_gid.in).
-    * When a new user (or group) is created on Savannah, the php code
+    * When a new user (or group) is created on Savannah, the PHP code
       on `frontend` does not assign uid/gid.
     * This script picks up new users (SQL: `user.uidNumber is NULL`) and
       new groups (SQL: `groups.gidNumber is NULL`) and assigns them ids.
 
-* `sv_mailman` - queries the `mail_group_list` table, and creates and updates
-  the mailing lists on `lists.gnu.org`.
-    * Source code:
-      
[/backend/mail/sv_mailman.in](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/mail/sv_mailman.in).
-    * This script is tightly-coupled with the PHP code in
-      
[/frontend/php/mail/admin/index.php](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/frontend/php/mail/admin/index.php).
-    * The `index.php` code sets the `mail_group_list.status` field to the
-      requested new status, and the `sv_mailman` script executes the
-      changes and updates the database.
-    * `sv_mailman` calls `mgt0:/usr/sbin/newlist`. The `newlist`
-      script is a stub which delegates the call to `lists.gnu.org` using
-      SSH. See [[MailSystem]] for more details.  
-      The gist of `mgt0:/usr/sbin/newlist` is:
+* `sv_cleaner` - Removes parts of the database that belong to removed entities.
 
-            #!/bin/bash
-            list_full_name=$1
-            admin_mail=$2
-            password=$3
-            cat <<EOF | ssh -T -i ~/.ssh/id_dsa.lists.gnu.org 
list@lists.gnu.org
-            COMMAND=newlist
-            LIST_FULL_NAME=$list_full_name
-            ADMIN_MAIL=$admin_mail
-            PASSWORD=$password
-            EOF
-
-
-* `sv_cleaner` - cleans up left-overs from interrupted PHP code?
-  * source code:
-    
[/backend/misc/sv_cleaner.in](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/misc/sv_cleaner.in).
-  * FIXME: investigate this script.
-
 * `sv_reminder` - sends email reminders to users.
-  * source code:
-    
[/backend/misc/sv_reminder.in](http://git.savannah.gnu.org/cgit/administration/savane.git/tree/backend/misc/sv_reminder.in).
-  * The help message says:
 
-            This script will send reminder to users in some specific cases. 
-            Case 1: an item is about to start or finish, all people from the 
item 
-            notification list should be warned. 
-            Case 2: an user decided to receive a batch of open item assigned to
-            him each x days, minimum priority being > 5
-            Case 3: a group admin decided that members assigned to some item 
of 
-            should receive a batch each x days, minimum priority > 5
-            (Case 4: a group admin decided that members assigned to some item
-            whose statut/resolution havent changed for some period should 
receive
-            a batch each x days)
-
-  * FIXME: investigate this script.
-
 ### www.gnu.org update mechanism
 
 ### Mailing list configuration