Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:21:14 +0000 (14:21 +0000)]
Load DadIDPrelim; adjust DadID and DadIDPub accordingly
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:19:18 +0000 (14:19 +0000)]
Remove trailing newlines from file
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:15:47 +0000 (14:15 +0000)]
Do not limit AnimID length, to match BIOGRAPHY
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:14:36 +0000 (14:14 +0000)]
Add missing FROM clauses
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 01:45:09 +0000 (01:45 +0000)]
Fix minimum age of parent at time of birth calculation
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 22:56:20 +0000 (22:56 +0000)]
Cleanup data required to tidy data types, fixes problem #10
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:47:06 +0000 (21:47 +0000)]
Improve description of file
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:45:12 +0000 (21:45 +0000)]
These cleanups were done in the upstream data
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:42:38 +0000 (21:42 +0000)]
Explain why permissions are set only on raw
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:38:01 +0000 (21:38 +0000)]
Have BIOGRAPHY.DadIDPub follow the same NULL rules as DadPrelim
This change is questionable, since querying on DadIDPub would be
slightly wonky. But we don't really anticipate queries.
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:37:06 +0000 (21:37 +0000)]
Add BIOGRAPHY.DadID_Prelim column
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:10:08 +0000 (21:10 +0000)]
New macro for if and only if NULL values
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:08:36 +0000 (21:08 +0000)]
Better BIOGRAPHY.DadID description
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:06:29 +0000 (21:06 +0000)]
Note where BIOGRAPHY.AnimIDs come from
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 20:44:13 +0000 (20:44 +0000)]
Reword the standard "empty text" phrasings
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:16:25 +0000 (09:16 +0000)]
Revert all code that changes the FOLLOW_MAP_TIME DDL statement on db load
The data still contains duplicate keys.
This reverts commit
ea49f4a06ac3ef8c2aec1e8fbc0c08703bca36d7.
This reverts commit
3e206bacf3a14ed9a242e766c1b1e590104890dc.
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:08:55 +0000 (09:08 +0000)]
Do not change the FOLLOW_MAP_TIME DDL statement at all
Finishes the fix made in
ea49f4a06ac.
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:45:18 +0000 (02:45 +0000)]
Properly pick up variables from the environment
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:43:57 +0000 (02:43 +0000)]
Improve docs for create-schema target
Karl O. Pinc [Thu, 30 Nov 2023 21:31:11 +0000 (15:31 -0600)]
Progress towards moving demography data into a production-like structure
Karl O. Pinc [Thu, 30 Nov 2023 20:31:14 +0000 (14:31 -0600)]
Fix max lifespan constraint
Karl O. Pinc [Thu, 30 Nov 2023 19:47:46 +0000 (13:47 -0600)]
Change BIOGRAPHY.AnimIDNum to allow NULL, and fix constraint
Karl O. Pinc [Thu, 30 Nov 2023 19:24:38 +0000 (13:24 -0600)]
Fix column indexed
Karl O. Pinc [Tue, 28 Nov 2023 21:05:12 +0000 (15:05 -0600)]
Allow spaces in Name column; align code with docs
Karl O. Pinc [Tue, 28 Nov 2023 19:59:11 +0000 (13:59 -0600)]
Fix permissions
Karl O. Pinc [Tue, 28 Nov 2023 19:21:57 +0000 (13:21 -0600)]
Fix comments
Karl O. Pinc [Tue, 28 Nov 2023 18:31:06 +0000 (12:31 -0600)]
Convert data from the tidy to the easy schema
Karl O. Pinc [Tue, 28 Nov 2023 18:07:56 +0000 (12:07 -0600)]
Fix to use command line argument
Karl O. Pinc [Tue, 28 Nov 2023 17:07:19 +0000 (11:07 -0600)]
Require COMM_IDS.Name be unique
Karl O. Pinc [Sun, 26 Nov 2023 21:22:13 +0000 (15:22 -0600)]
Improve hint; SokweDB has "admin"s and no real superusers
Karl O. Pinc [Sun, 26 Nov 2023 21:21:19 +0000 (15:21 -0600)]
Document the "lib" schema
Karl O. Pinc [Sun, 26 Nov 2023 20:23:21 +0000 (14:23 -0600)]
Fix typo
Karl O. Pinc [Sun, 26 Nov 2023 20:22:37 +0000 (14:22 -0600)]
Move triggers and functions the user need not see into the "lib" schema
Karl O. Pinc [Sun, 19 Nov 2023 00:16:00 +0000 (18:16 -0600)]
Do not need to remove primary key declaration, the data has been cleaned
Karl O. Pinc [Sun, 12 Nov 2023 20:46:34 +0000 (14:46 -0600)]
Convert data into the tidy schema
As of now, this means cleaning up the data types of the "raw" schema
and checking that this does not discard any data.
Karl O. Pinc [Thu, 9 Nov 2023 21:24:16 +0000 (15:24 -0600)]
Separate psql setup vars for different schemas
Karl O. Pinc [Thu, 9 Nov 2023 20:03:12 +0000 (14:03 -0600)]
Stop if there's an error loading the db
Karl O. Pinc [Thu, 9 Nov 2023 16:54:50 +0000 (10:54 -0600)]
Make executable
Karl O. Pinc [Thu, 9 Nov 2023 16:33:42 +0000 (10:33 -0600)]
Change default conversion schema to "raw"
Karl O. Pinc [Thu, 9 Nov 2023 16:31:58 +0000 (10:31 -0600)]
Separate file for db speed settings
Karl O. Pinc [Thu, 9 Nov 2023 16:24:25 +0000 (10:24 -0600)]
Make "old" the default db for converting
Karl O. Pinc [Thu, 9 Nov 2023 16:20:16 +0000 (10:20 -0600)]
System to load MS Access dump into Postgres
Karl O. Pinc [Tue, 7 Nov 2023 18:45:17 +0000 (12:45 -0600)]
Use variable instead of hardcoding
Karl O. Pinc [Fri, 3 Nov 2023 22:08:02 +0000 (17:08 -0500)]
Redo the table name arrow
For reasons not understood, the arrow glyph at the end of the
old arrow was rotated 90 degrees when displayed on the web page.
Karl O. Pinc [Mon, 30 Oct 2023 21:25:10 +0000 (16:25 -0500)]
Configure Sphinx theme and RST figures to display SVG full-screen width
Karl O. Pinc [Fri, 27 Oct 2023 22:39:26 +0000 (17:39 -0500)]
The demography er diagram
Karl O. Pinc kop@karlpinc.com [Fri, 20 Oct 2023 21:11:18 +0000 (21:11 +0000)]
Move system-level commands into the sokwe_server repo
Karl O. Pinc [Sun, 15 Oct 2023 17:48:47 +0000 (12:48 -0500)]
Document hardcoding of cluster init and provide related control variables
Karl O. Pinc [Fri, 13 Oct 2023 15:33:40 +0000 (10:33 -0500)]
Fix copyright/author contact info
Karl O. Pinc kop@karlpinc.com [Fri, 13 Oct 2023 16:24:10 +0000 (16:24 +0000)]
New command to support VPN for port forwarding to pg server
Stevan Earl [Thu, 12 Oct 2023 18:00:30 +0000 (11:00 -0700)]
docs: added url to wikipage on build system
Providing richer resources for working with the build system that are
beyond the scope of the Make documentation.
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 03:00:13 +0000 (03:00 +0000)]
Transaction isolation is now configured to be serializable
There are also new settings for PG 15, but it's too much of a hassle
to break these into a separate commit. Especially since there's
no production data yet.
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:54:42 +0000 (02:54 +0000)]
New az server settings removed "anon" from available shared libraries
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:00:36 +0000 (02:00 +0000)]
No need to end db comments with a newline
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:52:47 +0000 (01:52 +0000)]
Only look for db comments in *.rst files
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:37:30 +0000 (01:37 +0000)]
Improve cluster creation docs
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 01:34:42 +0000 (01:34 +0000)]
Must be able to assume the role to create an object owned by the role
Unless of course you're a superuser.
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 00:55:27 +0000 (00:55 +0000)]
Improve error message when group is wrong
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 02:13:20 +0000 (02:13 +0000)]
Fix latex doc builds
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 01:18:03 +0000 (01:18 +0000)]
Account for empty db/schemas/*/create/ directories
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 01:15:34 +0000 (01:15 +0000)]
There is nothing in the upload directory; temporarly comment out
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:58:26 +0000 (00:58 +0000)]
Properly pass the schema to gen_func_comment_tmpl()
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:40:24 +0000 (00:40 +0000)]
Avoid a stack trace when raising DuplicateError
Karl O. Pinc kop@karlpinc.com [Sat, 7 Oct 2023 00:21:26 +0000 (00:21 +0000)]
Add an informative error message for when comment SQL can't be made
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:23:46 +0000 (23:23 +0000)]
Add caution about installing db components in a piece-wise fashion
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:15:50 +0000 (23:15 +0000)]
Ensure function installation into the db is before comment generation
Function signatures cannot be obtained until after functions are
put into the database. This means that comment SQL cannot be generated
before functions go in. Alter the big install/re-install targets to
be sure that things happen in the right order.
The user can still invoke the "installcomments" target without having
all the functions installed. In this case comment installation fails.
It is up to the user to install things in the proper order, as with
tables and views, when invoking targets that install piecemeal.
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 23:11:13 +0000 (23:11 +0000)]
Be consistent with PSQL_DEPENDS dependency placement
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 19:53:35 +0000 (19:53 +0000)]
Fix install target docs
Karl O. Pinc kop@karlpinc.com [Fri, 6 Oct 2023 19:43:40 +0000 (19:43 +0000)]
Remove <schema>/comments/ with clean-db
Karl O. Pinc [Fri, 6 Oct 2023 19:27:23 +0000 (14:27 -0500)]
Document default pg host
Karl O. Pinc [Fri, 6 Oct 2023 19:16:46 +0000 (14:16 -0500)]
Improve DATABASE TARGETS docs
Karl O. Pinc [Fri, 6 Oct 2023 19:15:05 +0000 (14:15 -0500)]
Name the devloper's database "sokwedb_dev", not "sokwedb_copy"
Karl O. Pinc [Fri, 6 Oct 2023 19:06:39 +0000 (14:06 -0500)]
Add user management commands: sokwedb-user-add, sokwedb-user-delete
Karl O. Pinc [Thu, 5 Oct 2023 14:46:01 +0000 (09:46 -0500)]
Remove unnecessary program
Karl O. Pinc [Thu, 5 Oct 2023 02:19:22 +0000 (21:19 -0500)]
Much improve the build system's performance
Have make cache the creation of targets that:
Put things in the database.
No point in connecting to the db all the time when
we don't need to.
Create directories.
There are separate targets for directory creation dependencies
so that adding to/deleting from directories themselves don't
change the dependent timestamp.
Create complex targets.
Some targets build things that are too complex to easily
test, in a later make run, that the target has been successfully
completed.
In all the above cases the build system used to go ahead and do the
extra work. But now, gen_comments.py takes a long time to run
and it's really annoying to wait all the time.
Karl O. Pinc [Thu, 5 Oct 2023 02:14:58 +0000 (21:14 -0500)]
Fix to cleanup comment sql
Karl O. Pinc [Wed, 4 Oct 2023 16:51:07 +0000 (11:51 -0500)]
Fix indentation
Karl O. Pinc [Wed, 4 Oct 2023 03:00:30 +0000 (22:00 -0500)]
Run comments taken from the docs through Sphinx to make the in-db text
Karl O. Pinc [Wed, 4 Oct 2023 02:58:09 +0000 (21:58 -0500)]
Fix trigger RETURN statements
Karl O. Pinc [Wed, 4 Oct 2023 02:47:45 +0000 (21:47 -0500)]
Better sentence
Karl O. Pinc [Tue, 3 Oct 2023 01:02:51 +0000 (20:02 -0500)]
All non-html formats have the same epilog
Karl O. Pinc [Sun, 1 Oct 2023 22:18:40 +0000 (17:18 -0500)]
Fix to capture comments at the end of a file
Technically, this shouldn't be necessary because the convention is to
declare the comment and then use it. So no comment replacment text
should be at the end of the file. But having a function makes
the code more clear and no harm in having code that always works.
Karl O. Pinc [Sun, 1 Oct 2023 21:56:21 +0000 (16:56 -0500)]
Empty lines do not end indent blocks
Karl O. Pinc [Sun, 1 Oct 2023 21:35:46 +0000 (16:35 -0500)]
Trigger functions must RETURN
Karl O. Pinc [Sun, 1 Oct 2023 21:29:51 +0000 (16:29 -0500)]
Simplify logic
Karl O. Pinc [Sun, 1 Oct 2023 21:23:39 +0000 (16:23 -0500)]
Reformat with black
Karl O. Pinc [Sun, 1 Oct 2023 21:16:49 +0000 (16:16 -0500)]
Move make documentation above make db
This is necessary or making the db comments won't work, they depend
on $(HTML_RST_FILES) being defined when the comments are collected.
Karl O. Pinc [Sun, 1 Oct 2023 21:16:34 +0000 (16:16 -0500)]
Directories must exist before the RST can
Karl O. Pinc [Sun, 1 Oct 2023 21:03:11 +0000 (16:03 -0500)]
Put dependencies in the right order
Karl O. Pinc [Sun, 1 Oct 2023 20:48:06 +0000 (15:48 -0500)]
Move secondexpansion make code into it's own file
Karl O. Pinc [Sun, 1 Oct 2023 20:44:12 +0000 (15:44 -0500)]
Put cluster creation stuff in it's own file
Karl O. Pinc [Sun, 1 Oct 2023 20:37:59 +0000 (15:37 -0500)]
Give the database connection variables their own doc heading
Karl O. Pinc [Sun, 1 Oct 2023 20:22:58 +0000 (15:22 -0500)]
Add dependencies everywhere psql is called
Karl O. Pinc [Sun, 1 Oct 2023 19:59:29 +0000 (14:59 -0500)]
Add db comments for columns
Karl O. Pinc [Sun, 1 Oct 2023 19:57:19 +0000 (14:57 -0500)]
Column names should not contain underscores
Karl O. Pinc [Sun, 1 Oct 2023 19:13:43 +0000 (14:13 -0500)]
Basics of putting comments into the db
Karl O. Pinc [Sun, 1 Oct 2023 19:06:43 +0000 (14:06 -0500)]
Put julian_to() into it's own file
The db commenting build system requires a file per function name.
Karl O. Pinc [Thu, 28 Sep 2023 13:01:10 +0000 (08:01 -0500)]
Use make function instead of shell function
Karl O. Pinc [Thu, 28 Sep 2023 04:10:23 +0000 (23:10 -0500)]
Fix removal of leading empty lines
Karl O. Pinc [Thu, 28 Sep 2023 04:09:46 +0000 (23:09 -0500)]
Better function documentation