sokwedb
14 months agoAdd BIOGRAPHY.DadPrelim substitution refrence
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:28:20 +0000 (16:28 +0000)]
Add BIOGRAPHY.DadPrelim substitution refrence

14 months agoIn diagram, change name BIOGRAPHY->BIOGRAPHY_DATA and add DadIDPrelim column
Karl O. Pinc [Fri, 19 Jan 2024 23:02:42 +0000 (17:02 -0600)]
In diagram, change name BIOGRAPHY->BIOGRAPHY_DATA and add DadIDPrelim column

14 months agoReduce the HTML sidebar table of contents level to 2
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 22:48:54 +0000 (22:48 +0000)]
Reduce the HTML sidebar table of contents level to 2

14 months agoBetter docs for DATA_FILE conversion variable
Karl O. Pinc [Tue, 12 Dec 2023 00:10:01 +0000 (18:10 -0600)]
Better docs for DATA_FILE conversion variable

14 months agoRemove more code which worked around invalid primary key data in dump
Karl O. Pinc [Tue, 12 Dec 2023 00:07:59 +0000 (18:07 -0600)]
Remove more code which worked around invalid primary key data in dump

This goes with commit: ea49f4a06a

14 months agoNew limits ("final" for the ones that exist now) based on group meeting
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 19:53:52 +0000 (19:53 +0000)]
New limits ("final" for the ones that exist now) based on group meeting

14 months agoUpdate based on initial data conversion
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 16:47:44 +0000 (16:47 +0000)]
Update based on initial data conversion

14 months agoEnforce rule that EntryDate <= DepartDate
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:39:02 +0000 (14:39 +0000)]
Enforce rule that EntryDate <= DepartDate

14 months agoAlign community code max length with that of the code table
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:25:01 +0000 (14:25 +0000)]
Align community code max length with that of the code table

14 months agoTesting for contiguous membership requires membership in one community
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:23:35 +0000 (14:23 +0000)]
Testing for contiguous membership requires membership in one community

14 months agoFix syntax error
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:22:13 +0000 (14:22 +0000)]
Fix syntax error

14 months agoLoad DadIDPrelim; adjust DadID and DadIDPub accordingly
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:21:14 +0000 (14:21 +0000)]
Load DadIDPrelim; adjust DadID and DadIDPub accordingly

14 months agoRemove trailing newlines from file
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:19:18 +0000 (14:19 +0000)]
Remove trailing newlines from file

14 months agoDo not limit AnimID length, to match BIOGRAPHY
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:15:47 +0000 (14:15 +0000)]
Do not limit AnimID length, to match BIOGRAPHY

14 months agoAdd missing FROM clauses
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:14:36 +0000 (14:14 +0000)]
Add missing FROM clauses

14 months agoFix minimum age of parent at time of birth calculation
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 01:45:09 +0000 (01:45 +0000)]
Fix minimum age of parent at time of birth calculation

14 months agoCleanup data required to tidy data types, fixes problem #10
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 22:56:20 +0000 (22:56 +0000)]
Cleanup data required to tidy data types, fixes problem #10

14 months agoImprove description of file
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:47:06 +0000 (21:47 +0000)]
Improve description of file

14 months agoThese cleanups were done in the upstream data
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:45:12 +0000 (21:45 +0000)]
These cleanups were done in the upstream data

14 months agoExplain why permissions are set only on raw
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:42:38 +0000 (21:42 +0000)]
Explain why permissions are set only on raw

14 months agoHave BIOGRAPHY.DadIDPub follow the same NULL rules as DadPrelim
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:38:01 +0000 (21:38 +0000)]
Have BIOGRAPHY.DadIDPub follow the same NULL rules as DadPrelim

This change is questionable, since querying on DadIDPub would be
slightly wonky.  But we don't really anticipate queries.

14 months agoAdd BIOGRAPHY.DadID_Prelim column
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:37:06 +0000 (21:37 +0000)]
Add BIOGRAPHY.DadID_Prelim column

14 months agoNew macro for if and only if NULL values
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:10:08 +0000 (21:10 +0000)]
New macro for if and only if NULL values

14 months agoBetter BIOGRAPHY.DadID description
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:08:36 +0000 (21:08 +0000)]
Better BIOGRAPHY.DadID description

14 months agoNote where BIOGRAPHY.AnimIDs come from
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:06:29 +0000 (21:06 +0000)]
Note where BIOGRAPHY.AnimIDs come from

14 months agoReword the standard "empty text" phrasings
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 20:44:13 +0000 (20:44 +0000)]
Reword the standard "empty text" phrasings

14 months agoRevert all code that changes the FOLLOW_MAP_TIME DDL statement on db load
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:16:25 +0000 (09:16 +0000)]
Revert all code that changes the FOLLOW_MAP_TIME DDL statement on db load

The data still contains duplicate keys.

This reverts commit ea49f4a06ac3ef8c2aec1e8fbc0c08703bca36d7.
This reverts commit 3e206bacf3a14ed9a242e766c1b1e590104890dc.

14 months agoDo not change the FOLLOW_MAP_TIME DDL statement at all
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:08:55 +0000 (09:08 +0000)]
Do not change the FOLLOW_MAP_TIME DDL statement at all

Finishes the fix made in ea49f4a06ac.

14 months agoProperly pick up variables from the environment
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:45:18 +0000 (02:45 +0000)]
Properly pick up variables from the environment

14 months agoImprove docs for create-schema target
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:43:57 +0000 (02:43 +0000)]
Improve docs for create-schema target

16 months agoProgress towards moving demography data into a production-like structure
Karl O. Pinc [Thu, 30 Nov 2023 21:31:11 +0000 (15:31 -0600)]
Progress towards moving demography data into a production-like structure

16 months agoFix max lifespan constraint
Karl O. Pinc [Thu, 30 Nov 2023 20:31:14 +0000 (14:31 -0600)]
Fix max lifespan constraint

16 months agoChange BIOGRAPHY.AnimIDNum to allow NULL, and fix constraint
Karl O. Pinc [Thu, 30 Nov 2023 19:47:46 +0000 (13:47 -0600)]
Change BIOGRAPHY.AnimIDNum to allow NULL, and fix constraint

16 months agoFix column indexed
Karl O. Pinc [Thu, 30 Nov 2023 19:24:38 +0000 (13:24 -0600)]
Fix column indexed

16 months agoAllow spaces in Name column; align code with docs
Karl O. Pinc [Tue, 28 Nov 2023 21:05:12 +0000 (15:05 -0600)]
Allow spaces in Name column; align code with docs

16 months agoFix permissions
Karl O. Pinc [Tue, 28 Nov 2023 19:59:11 +0000 (13:59 -0600)]
Fix permissions

16 months agoFix comments
Karl O. Pinc [Tue, 28 Nov 2023 19:21:57 +0000 (13:21 -0600)]
Fix comments

16 months agoConvert data from the tidy to the easy schema
Karl O. Pinc [Tue, 28 Nov 2023 18:31:06 +0000 (12:31 -0600)]
Convert data from the tidy to the easy schema

16 months agoFix to use command line argument
Karl O. Pinc [Tue, 28 Nov 2023 18:07:56 +0000 (12:07 -0600)]
Fix to use command line argument

16 months agoRequire COMM_IDS.Name be unique
Karl O. Pinc [Tue, 28 Nov 2023 17:07:19 +0000 (11:07 -0600)]
Require COMM_IDS.Name be unique

16 months agoImprove hint; SokweDB has "admin"s and no real superusers
Karl O. Pinc [Sun, 26 Nov 2023 21:22:13 +0000 (15:22 -0600)]
Improve hint; SokweDB has "admin"s and no real superusers

16 months agoDocument the "lib" schema
Karl O. Pinc [Sun, 26 Nov 2023 21:21:19 +0000 (15:21 -0600)]
Document the "lib" schema

16 months agoFix typo
Karl O. Pinc [Sun, 26 Nov 2023 20:23:21 +0000 (14:23 -0600)]
Fix typo

16 months agoMove triggers and functions the user need not see into the "lib" schema
Karl O. Pinc [Sun, 26 Nov 2023 20:22:37 +0000 (14:22 -0600)]
Move triggers and functions the user need not see into the "lib" schema

16 months agoDo not need to remove primary key declaration, the data has been cleaned
Karl O. Pinc [Sun, 19 Nov 2023 00:16:00 +0000 (18:16 -0600)]
Do not need to remove primary key declaration, the data has been cleaned

16 months agoConvert data into the tidy schema
Karl O. Pinc [Sun, 12 Nov 2023 20:46:34 +0000 (14:46 -0600)]
Convert data into the tidy schema

As of now, this means cleaning up the data types of the "raw" schema
and checking that this does not discard any data.

16 months agoSeparate psql setup vars for different schemas
Karl O. Pinc [Thu, 9 Nov 2023 21:24:16 +0000 (15:24 -0600)]
Separate psql setup vars for different schemas

16 months agoStop if there's an error loading the db
Karl O. Pinc [Thu, 9 Nov 2023 20:03:12 +0000 (14:03 -0600)]
Stop if there's an error loading the db

16 months agoMake executable
Karl O. Pinc [Thu, 9 Nov 2023 16:54:50 +0000 (10:54 -0600)]
Make executable

16 months agoChange default conversion schema to "raw"
Karl O. Pinc [Thu, 9 Nov 2023 16:33:42 +0000 (10:33 -0600)]
Change default conversion schema to "raw"

16 months agoSeparate file for db speed settings
Karl O. Pinc [Thu, 9 Nov 2023 16:31:58 +0000 (10:31 -0600)]
Separate file for db speed settings

16 months agoMake "old" the default db for converting
Karl O. Pinc [Thu, 9 Nov 2023 16:24:25 +0000 (10:24 -0600)]
Make "old" the default db for converting

16 months agoSystem to load MS Access dump into Postgres
Karl O. Pinc [Thu, 9 Nov 2023 16:20:16 +0000 (10:20 -0600)]
System to load MS Access dump into Postgres

16 months agoUse variable instead of hardcoding
Karl O. Pinc [Tue, 7 Nov 2023 18:45:17 +0000 (12:45 -0600)]
Use variable instead of hardcoding

17 months agoRedo the table name arrow
Karl O. Pinc [Fri, 3 Nov 2023 22:08:02 +0000 (17:08 -0500)]
Redo the table name arrow

For reasons not understood, the arrow glyph at the end of the
old arrow was rotated 90 degrees when displayed on the web page.

17 months agoConfigure Sphinx theme and RST figures to display SVG full-screen width
Karl O. Pinc [Mon, 30 Oct 2023 21:25:10 +0000 (16:25 -0500)]
Configure Sphinx theme and RST figures to display SVG full-screen width

17 months agoThe demography er diagram
Karl O. Pinc [Fri, 27 Oct 2023 22:39:26 +0000 (17:39 -0500)]
The demography er diagram

17 months agoMove system-level commands into the sokwe_server repo
Karl O. Pinc kop@karlpinc.com [Fri, 20 Oct 2023 21:11:18 +0000 (21:11 +0000)]
Move system-level commands into the sokwe_server repo

17 months agoDocument hardcoding of cluster init and provide related control variables
Karl O. Pinc [Sun, 15 Oct 2023 17:48:47 +0000 (12:48 -0500)]
Document hardcoding of cluster init and provide related control variables

17 months agoFix copyright/author contact info
Karl O. Pinc [Fri, 13 Oct 2023 15:33:40 +0000 (10:33 -0500)]
Fix copyright/author contact info

17 months agoNew command to support VPN for port forwarding to pg server
Karl O. Pinc kop@karlpinc.com [Fri, 13 Oct 2023 16:24:10 +0000 (16:24 +0000)]
New command to support VPN for port forwarding to pg server

17 months agodocs: added url to wikipage on build system
Stevan Earl [Thu, 12 Oct 2023 18:00:30 +0000 (11:00 -0700)]
docs: added url to wikipage on build system

Providing richer resources for working with the build system that are
beyond the scope of the Make documentation.

17 months agoTransaction isolation is now configured to be serializable
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 03:00:13 +0000 (03:00 +0000)]
Transaction isolation is now configured to be serializable

There are also new settings for PG 15, but it's too much of a hassle
to break these into a separate commit.  Especially since there's
no production data yet.

17 months agoNew az server settings removed "anon" from available shared libraries
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:54:42 +0000 (02:54 +0000)]
New az server settings removed "anon" from available shared libraries

17 months agoNo need to end db comments with a newline
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:00:36 +0000 (02:00 +0000)]
No need to end db comments with a newline

17 months agoOnly look for db comments in *.rst files
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:52:47 +0000 (01:52 +0000)]
Only look for db comments in *.rst files

17 months agoImprove cluster creation docs
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:37:30 +0000 (01:37 +0000)]
Improve cluster creation docs

17 months agoMust be able to assume the role to create an object owned by the role
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:34:42 +0000 (01:34 +0000)]
Must be able to assume the role to create an object owned by the role

Unless of course you're a superuser.

17 months agoImprove error message when group is wrong
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 00:55:27 +0000 (00:55 +0000)]
Improve error message when group is wrong

17 months agoFix latex doc builds
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 02:13:20 +0000 (02:13 +0000)]
Fix latex doc builds

17 months agoAccount for empty db/schemas/*/create/ directories
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 01:18:03 +0000 (01:18 +0000)]
Account for empty db/schemas/*/create/ directories

17 months agoThere is nothing in the upload directory; temporarly comment out
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 01:15:34 +0000 (01:15 +0000)]
There is nothing in the upload directory; temporarly comment out

17 months agoProperly pass the schema to gen_func_comment_tmpl()
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:58:26 +0000 (00:58 +0000)]
Properly pass the schema to gen_func_comment_tmpl()

17 months agoAvoid a stack trace when raising DuplicateError
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:40:24 +0000 (00:40 +0000)]
Avoid a stack trace when raising DuplicateError

17 months agoAdd an informative error message for when comment SQL can't be made
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:21:26 +0000 (00:21 +0000)]
Add an informative error message for when comment SQL can't be made

17 months agoAdd caution about installing db components in a piece-wise fashion
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:23:46 +0000 (23:23 +0000)]
Add caution about installing db components in a piece-wise fashion

17 months agoEnsure function installation into the db is before comment generation
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:15:50 +0000 (23:15 +0000)]
Ensure function installation into the db is before comment generation

Function signatures cannot be obtained until after functions are
put into the database.  This means that comment SQL cannot be generated
before functions go in.  Alter the big install/re-install targets to
be sure that things happen in the right order.

The user can still invoke the "installcomments" target without having
all the functions installed.  In this case comment installation fails.
It is up to the user to install things in the proper order, as with
tables and views, when invoking targets that install piecemeal.

17 months agoBe consistent with PSQL_DEPENDS dependency placement
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:11:13 +0000 (23:11 +0000)]
Be consistent with PSQL_DEPENDS dependency placement

17 months agoFix install target docs
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 19:53:35 +0000 (19:53 +0000)]
Fix install target docs

17 months agoRemove <schema>/comments/ with clean-db
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 19:43:40 +0000 (19:43 +0000)]
Remove <schema>/comments/ with clean-db

17 months agoDocument default pg host
Karl O. Pinc [Fri, 6 Oct 2023 19:27:23 +0000 (14:27 -0500)]
Document default pg host

17 months agoImprove DATABASE TARGETS docs
Karl O. Pinc [Fri, 6 Oct 2023 19:16:46 +0000 (14:16 -0500)]
Improve DATABASE TARGETS docs

17 months agoName the devloper's database "sokwedb_dev", not "sokwedb_copy"
Karl O. Pinc [Fri, 6 Oct 2023 19:15:05 +0000 (14:15 -0500)]
Name the devloper's database "sokwedb_dev", not "sokwedb_copy"

17 months agoAdd user management commands: sokwedb-user-add, sokwedb-user-delete
Karl O. Pinc [Fri, 6 Oct 2023 19:06:39 +0000 (14:06 -0500)]
Add user management commands: sokwedb-user-add, sokwedb-user-delete

18 months agoRemove unnecessary program
Karl O. Pinc [Thu, 5 Oct 2023 14:46:01 +0000 (09:46 -0500)]
Remove unnecessary program

18 months agoMuch improve the build system's performance
Karl O. Pinc [Thu, 5 Oct 2023 02:19:22 +0000 (21:19 -0500)]
Much improve the build system's performance

Have make cache the creation of targets that:
  Put things in the database.
    No point in connecting to the db all the time when
    we don't need to.
  Create directories.
    There are separate targets for directory creation dependencies
    so that adding to/deleting from directories themselves don't
    change the dependent timestamp.
  Create complex targets.
    Some targets build things that are too complex to easily
    test, in a later make run, that the target has been successfully
    completed.

In all the above cases the build system used to go ahead and do the
extra work. But now, gen_comments.py takes a long time to run
and it's really annoying to wait all the time.

18 months agoFix to cleanup comment sql
Karl O. Pinc [Thu, 5 Oct 2023 02:14:58 +0000 (21:14 -0500)]
Fix to cleanup comment sql

18 months agoFix indentation
Karl O. Pinc [Wed, 4 Oct 2023 16:51:07 +0000 (11:51 -0500)]
Fix indentation

18 months agoRun comments taken from the docs through Sphinx to make the in-db text
Karl O. Pinc [Wed, 4 Oct 2023 03:00:30 +0000 (22:00 -0500)]
Run comments taken from the docs through Sphinx to make the in-db text

18 months agoFix trigger RETURN statements
Karl O. Pinc [Wed, 4 Oct 2023 02:58:09 +0000 (21:58 -0500)]
Fix trigger RETURN statements

18 months agoBetter sentence
Karl O. Pinc [Wed, 4 Oct 2023 02:47:45 +0000 (21:47 -0500)]
Better sentence

18 months agoAll non-html formats have the same epilog
Karl O. Pinc [Tue, 3 Oct 2023 01:02:51 +0000 (20:02 -0500)]
All non-html formats have the same epilog

18 months agoFix to capture comments at the end of a file
Karl O. Pinc [Sun, 1 Oct 2023 22:18:40 +0000 (17:18 -0500)]
Fix to capture comments at the end of a file

Technically, this shouldn't be necessary because the convention is to
declare the comment and then use it.  So no comment replacment text
should be at the end of the file.  But having a function makes
the code more clear and no harm in having code that always works.

18 months agoEmpty lines do not end indent blocks
Karl O. Pinc [Sun, 1 Oct 2023 21:56:21 +0000 (16:56 -0500)]
Empty lines do not end indent blocks

18 months agoTrigger functions must RETURN
Karl O. Pinc [Sun, 1 Oct 2023 21:35:46 +0000 (16:35 -0500)]
Trigger functions must RETURN

18 months agoSimplify logic
Karl O. Pinc [Sun, 1 Oct 2023 21:29:51 +0000 (16:29 -0500)]
Simplify logic

18 months agoReformat with black
Karl O. Pinc [Sun, 1 Oct 2023 21:23:39 +0000 (16:23 -0500)]
Reformat with black

18 months agoMove make documentation above make db
Karl O. Pinc [Sun, 1 Oct 2023 21:16:49 +0000 (16:16 -0500)]
Move make documentation above make db

This is necessary or making the db comments won't work, they depend
on $(HTML_RST_FILES) being defined when the comments are collected.

18 months agoDirectories must exist before the RST can
Karl O. Pinc [Sun, 1 Oct 2023 21:16:34 +0000 (16:16 -0500)]
Directories must exist before the RST can

18 months agoPut dependencies in the right order
Karl O. Pinc [Sun, 1 Oct 2023 21:03:11 +0000 (16:03 -0500)]
Put dependencies in the right order