Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 20:56:51 +0000 (20:56 +0000)]
Clean up "biography_update_log.made by" column to remove space
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 20:56:03 +0000 (20:56 +0000)]
Make a PEOPLE table in the "clean" schema to support bad data queries
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 19:29:00 +0000 (19:29 +0000)]
Index biography_log and comm_memb_log
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 19:19:30 +0000 (19:19 +0000)]
Add LIMIT to SELECT INTO, and ORDER BY for consistant errors results
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 18:12:00 +0000 (18:12 +0000)]
Fix AnimID column docs, must not be null, plus other columns
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 17:58:52 +0000 (17:58 +0000)]
Create BIOGRAPHY_LOG and update docs with actual constraints
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 17:40:49 +0000 (17:40 +0000)]
Document BIOGRAPHY_LOG
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 17:38:14 +0000 (17:38 +0000)]
Remove empty trailing line
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:38:03 +0000 (16:38 +0000)]
Move DadID, DadIDPub, and DadPrelim relationships into the overview
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:37:59 +0000 (16:37 +0000)]
Mention both column names in the iff NULL docs
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:35:32 +0000 (16:35 +0000)]
Note what the special quotes are
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:28:20 +0000 (16:28 +0000)]
Add BIOGRAPHY.DadPrelim substitution refrence
Karl O. Pinc [Fri, 19 Jan 2024 23:02:42 +0000 (17:02 -0600)]
In diagram, change name BIOGRAPHY->BIOGRAPHY_DATA and add DadIDPrelim column
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 22:48:54 +0000 (22:48 +0000)]
Reduce the HTML sidebar table of contents level to 2
Karl O. Pinc [Tue, 12 Dec 2023 00:10:01 +0000 (18:10 -0600)]
Better docs for DATA_FILE conversion variable
Karl O. Pinc [Tue, 12 Dec 2023 00:07:59 +0000 (18:07 -0600)]
Remove more code which worked around invalid primary key data in dump
This goes with commit:
ea49f4a06a
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 19:53:52 +0000 (19:53 +0000)]
New limits ("final" for the ones that exist now) based on group meeting
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 16:47:44 +0000 (16:47 +0000)]
Update based on initial data conversion
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:39:02 +0000 (14:39 +0000)]
Enforce rule that EntryDate <= DepartDate
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:25:01 +0000 (14:25 +0000)]
Align community code max length with that of the code table
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:23:35 +0000 (14:23 +0000)]
Testing for contiguous membership requires membership in one community
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:22:13 +0000 (14:22 +0000)]
Fix syntax error
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:21:14 +0000 (14:21 +0000)]
Load DadIDPrelim; adjust DadID and DadIDPub accordingly
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:19:18 +0000 (14:19 +0000)]
Remove trailing newlines from file
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:15:47 +0000 (14:15 +0000)]
Do not limit AnimID length, to match BIOGRAPHY
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:14:36 +0000 (14:14 +0000)]
Add missing FROM clauses
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 01:45:09 +0000 (01:45 +0000)]
Fix minimum age of parent at time of birth calculation
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 22:56:20 +0000 (22:56 +0000)]
Cleanup data required to tidy data types, fixes problem #10
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:47:06 +0000 (21:47 +0000)]
Improve description of file
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:45:12 +0000 (21:45 +0000)]
These cleanups were done in the upstream data
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:42:38 +0000 (21:42 +0000)]
Explain why permissions are set only on raw
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:38:01 +0000 (21:38 +0000)]
Have BIOGRAPHY.DadIDPub follow the same NULL rules as DadPrelim
This change is questionable, since querying on DadIDPub would be
slightly wonky. But we don't really anticipate queries.
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:37:06 +0000 (21:37 +0000)]
Add BIOGRAPHY.DadID_Prelim column
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:10:08 +0000 (21:10 +0000)]
New macro for if and only if NULL values
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:08:36 +0000 (21:08 +0000)]
Better BIOGRAPHY.DadID description
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:06:29 +0000 (21:06 +0000)]
Note where BIOGRAPHY.AnimIDs come from
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 20:44:13 +0000 (20:44 +0000)]
Reword the standard "empty text" phrasings
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:16:25 +0000 (09:16 +0000)]
Revert all code that changes the FOLLOW_MAP_TIME DDL statement on db load
The data still contains duplicate keys.
This reverts commit
ea49f4a06ac3ef8c2aec1e8fbc0c08703bca36d7.
This reverts commit
3e206bacf3a14ed9a242e766c1b1e590104890dc.
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:08:55 +0000 (09:08 +0000)]
Do not change the FOLLOW_MAP_TIME DDL statement at all
Finishes the fix made in
ea49f4a06ac.
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:45:18 +0000 (02:45 +0000)]
Properly pick up variables from the environment
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:43:57 +0000 (02:43 +0000)]
Improve docs for create-schema target
Karl O. Pinc [Thu, 30 Nov 2023 21:31:11 +0000 (15:31 -0600)]
Progress towards moving demography data into a production-like structure
Karl O. Pinc [Thu, 30 Nov 2023 20:31:14 +0000 (14:31 -0600)]
Fix max lifespan constraint
Karl O. Pinc [Thu, 30 Nov 2023 19:47:46 +0000 (13:47 -0600)]
Change BIOGRAPHY.AnimIDNum to allow NULL, and fix constraint
Karl O. Pinc [Thu, 30 Nov 2023 19:24:38 +0000 (13:24 -0600)]
Fix column indexed
Karl O. Pinc [Tue, 28 Nov 2023 21:05:12 +0000 (15:05 -0600)]
Allow spaces in Name column; align code with docs
Karl O. Pinc [Tue, 28 Nov 2023 19:59:11 +0000 (13:59 -0600)]
Fix permissions
Karl O. Pinc [Tue, 28 Nov 2023 19:21:57 +0000 (13:21 -0600)]
Fix comments
Karl O. Pinc [Tue, 28 Nov 2023 18:31:06 +0000 (12:31 -0600)]
Convert data from the tidy to the easy schema
Karl O. Pinc [Tue, 28 Nov 2023 18:07:56 +0000 (12:07 -0600)]
Fix to use command line argument
Karl O. Pinc [Tue, 28 Nov 2023 17:07:19 +0000 (11:07 -0600)]
Require COMM_IDS.Name be unique
Karl O. Pinc [Sun, 26 Nov 2023 21:22:13 +0000 (15:22 -0600)]
Improve hint; SokweDB has "admin"s and no real superusers
Karl O. Pinc [Sun, 26 Nov 2023 21:21:19 +0000 (15:21 -0600)]
Document the "lib" schema
Karl O. Pinc [Sun, 26 Nov 2023 20:23:21 +0000 (14:23 -0600)]
Fix typo
Karl O. Pinc [Sun, 26 Nov 2023 20:22:37 +0000 (14:22 -0600)]
Move triggers and functions the user need not see into the "lib" schema
Karl O. Pinc [Sun, 19 Nov 2023 00:16:00 +0000 (18:16 -0600)]
Do not need to remove primary key declaration, the data has been cleaned
Karl O. Pinc [Sun, 12 Nov 2023 20:46:34 +0000 (14:46 -0600)]
Convert data into the tidy schema
As of now, this means cleaning up the data types of the "raw" schema
and checking that this does not discard any data.
Karl O. Pinc [Thu, 9 Nov 2023 21:24:16 +0000 (15:24 -0600)]
Separate psql setup vars for different schemas
Karl O. Pinc [Thu, 9 Nov 2023 20:03:12 +0000 (14:03 -0600)]
Stop if there's an error loading the db
Karl O. Pinc [Thu, 9 Nov 2023 16:54:50 +0000 (10:54 -0600)]
Make executable
Karl O. Pinc [Thu, 9 Nov 2023 16:33:42 +0000 (10:33 -0600)]
Change default conversion schema to "raw"
Karl O. Pinc [Thu, 9 Nov 2023 16:31:58 +0000 (10:31 -0600)]
Separate file for db speed settings
Karl O. Pinc [Thu, 9 Nov 2023 16:24:25 +0000 (10:24 -0600)]
Make "old" the default db for converting
Karl O. Pinc [Thu, 9 Nov 2023 16:20:16 +0000 (10:20 -0600)]
System to load MS Access dump into Postgres
Karl O. Pinc [Tue, 7 Nov 2023 18:45:17 +0000 (12:45 -0600)]
Use variable instead of hardcoding
Karl O. Pinc [Fri, 3 Nov 2023 22:08:02 +0000 (17:08 -0500)]
Redo the table name arrow
For reasons not understood, the arrow glyph at the end of the
old arrow was rotated 90 degrees when displayed on the web page.
Karl O. Pinc [Mon, 30 Oct 2023 21:25:10 +0000 (16:25 -0500)]
Configure Sphinx theme and RST figures to display SVG full-screen width
Karl O. Pinc [Fri, 27 Oct 2023 22:39:26 +0000 (17:39 -0500)]
The demography er diagram
Karl O. Pinc kop@karlpinc.com [Fri, 20 Oct 2023 21:11:18 +0000 (21:11 +0000)]
Move system-level commands into the sokwe_server repo
Karl O. Pinc [Sun, 15 Oct 2023 17:48:47 +0000 (12:48 -0500)]
Document hardcoding of cluster init and provide related control variables
Karl O. Pinc [Fri, 13 Oct 2023 15:33:40 +0000 (10:33 -0500)]
Fix copyright/author contact info
Karl O. Pinc kop@karlpinc.com [Fri, 13 Oct 2023 16:24:10 +0000 (16:24 +0000)]
New command to support VPN for port forwarding to pg server
Stevan Earl [Thu, 12 Oct 2023 18:00:30 +0000 (11:00 -0700)]
docs: added url to wikipage on build system
Providing richer resources for working with the build system that are
beyond the scope of the Make documentation.
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 03:00:13 +0000 (03:00 +0000)]
Transaction isolation is now configured to be serializable
There are also new settings for PG 15, but it's too much of a hassle
to break these into a separate commit. Especially since there's
no production data yet.
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:54:42 +0000 (02:54 +0000)]
New az server settings removed "anon" from available shared libraries
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:00:36 +0000 (02:00 +0000)]
No need to end db comments with a newline
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:52:47 +0000 (01:52 +0000)]
Only look for db comments in *.rst files
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:37:30 +0000 (01:37 +0000)]
Improve cluster creation docs
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:34:42 +0000 (01:34 +0000)]
Must be able to assume the role to create an object owned by the role
Unless of course you're a superuser.
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 00:55:27 +0000 (00:55 +0000)]
Improve error message when group is wrong
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 02:13:20 +0000 (02:13 +0000)]
Fix latex doc builds
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 01:18:03 +0000 (01:18 +0000)]
Account for empty db/schemas/*/create/ directories
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 01:15:34 +0000 (01:15 +0000)]
There is nothing in the upload directory; temporarly comment out
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:58:26 +0000 (00:58 +0000)]
Properly pass the schema to gen_func_comment_tmpl()
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:40:24 +0000 (00:40 +0000)]
Avoid a stack trace when raising DuplicateError
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:21:26 +0000 (00:21 +0000)]
Add an informative error message for when comment SQL can't be made
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:23:46 +0000 (23:23 +0000)]
Add caution about installing db components in a piece-wise fashion
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:15:50 +0000 (23:15 +0000)]
Ensure function installation into the db is before comment generation
Function signatures cannot be obtained until after functions are
put into the database. This means that comment SQL cannot be generated
before functions go in. Alter the big install/re-install targets to
be sure that things happen in the right order.
The user can still invoke the "installcomments" target without having
all the functions installed. In this case comment installation fails.
It is up to the user to install things in the proper order, as with
tables and views, when invoking targets that install piecemeal.
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:11:13 +0000 (23:11 +0000)]
Be consistent with PSQL_DEPENDS dependency placement
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 19:53:35 +0000 (19:53 +0000)]
Fix install target docs
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 19:43:40 +0000 (19:43 +0000)]
Remove <schema>/comments/ with clean-db
Karl O. Pinc [Fri, 6 Oct 2023 19:27:23 +0000 (14:27 -0500)]
Document default pg host
Karl O. Pinc [Fri, 6 Oct 2023 19:16:46 +0000 (14:16 -0500)]
Improve DATABASE TARGETS docs
Karl O. Pinc [Fri, 6 Oct 2023 19:15:05 +0000 (14:15 -0500)]
Name the devloper's database "sokwedb_dev", not "sokwedb_copy"
Karl O. Pinc [Fri, 6 Oct 2023 19:06:39 +0000 (14:06 -0500)]
Add user management commands: sokwedb-user-add, sokwedb-user-delete
Karl O. Pinc [Thu, 5 Oct 2023 14:46:01 +0000 (09:46 -0500)]
Remove unnecessary program
Karl O. Pinc [Thu, 5 Oct 2023 02:19:22 +0000 (21:19 -0500)]
Much improve the build system's performance
Have make cache the creation of targets that:
Put things in the database.
No point in connecting to the db all the time when
we don't need to.
Create directories.
There are separate targets for directory creation dependencies
so that adding to/deleting from directories themselves don't
change the dependent timestamp.
Create complex targets.
Some targets build things that are too complex to easily
test, in a later make run, that the target has been successfully
completed.
In all the above cases the build system used to go ahead and do the
extra work. But now, gen_comments.py takes a long time to run
and it's really annoying to wait all the time.
Karl O. Pinc [Thu, 5 Oct 2023 02:14:58 +0000 (21:14 -0500)]
Fix to cleanup comment sql
Karl O. Pinc [Wed, 4 Oct 2023 16:51:07 +0000 (11:51 -0500)]
Fix indentation
Karl O. Pinc [Wed, 4 Oct 2023 03:00:30 +0000 (22:00 -0500)]
Run comments taken from the docs through Sphinx to make the in-db text