TODO 32.4 KB
Newer Older
B
Bruce Momjian 已提交
1
TODO list for PostgreSQL
B
Bruce Momjian 已提交
2
========================
B
Bruce Momjian 已提交
3
#A dash (-) marks changes that will appear in the upcoming 8.1 release.#
4 5

Bracketed items "[]" have more detail.
M
Marc G. Fournier 已提交
6

B
Bruce Momjian 已提交
7
Current maintainer:	Bruce Momjian (pgman@candle.pha.pa.us)
B
Bruce Momjian 已提交
8
Last updated:		Sun Oct 17 23:26:56 EDT 2004
M
Marc G. Fournier 已提交
9

B
Bruce Momjian 已提交
10 11
The most recent version of this document can be viewed at the PostgreSQL web
site, http://www.PostgreSQL.org.
B
Bruce Momjian 已提交
12

B
Bruce Momjian 已提交
13

B
Bruce Momjian 已提交
14

15 16
Administration
==============
B
Bruce Momjian 已提交
17

B
Bruce Momjian 已提交
18 19
* Remove behavior of postmaster -o after making postmaster/postgres
  flags unique
B
Add:  
Bruce Momjian 已提交
20
* Allow limits on per-db/user connections
B
Add:  
Bruce Momjian 已提交
21 22
* Add group object ownership, so groups can rename/drop/grant on objects,
  so we can implement roles
B
Add:;  
Bruce Momjian 已提交
23
* Allow server log information to be output as INSERT statements
24 25 26 27

  This would allow server log information to be easily loaded into
  a database for analysis.

28
* Prevent default re-use of sysids for dropped users and groups
29 30 31 32 33

  Currently, if a user is removed while he still owns objects, a new
  user given might be given their user id and inherit the
  previous users objects.

34
* Prevent dropping user that still owns objects, or auto-drop the objects
35 36 37 38 39
* Allow pooled connections to list all prepared queries

  This would allow an application inheriting a pooled connection to know
  the queries prepared in the current session.

B
Add:  
Bruce Momjian 已提交
40
* Allow major upgrades without dump/reload, perhaps using pg_upgrade
41 42 43
* Have SHOW ALL and pg_settings show descriptions for server-side variables
* Allow GRANT/REVOKE permissions to be given to all schema objects with one 
  command
B
Bruce Momjian 已提交
44
* Remove unreferenced table files created by transactions that were
B
Bruce Momjian 已提交
45
  in-progress when the server terminated abruptly
B
Add:  
Bruce Momjian 已提交
46
* Allow reporting of which objects are in which tablespaces
47 48 49 50 51 52 53

  This item is difficult because a tablespace can contain objects from
  multiple databases. There is a server-side function that returns the
  databases which use a specific tablespace, so this requires a tool
  that will call that function and connect to each database to find the
  objects in each database for that tablespace.

B
Add:  
Bruce Momjian 已提交
54
* Allow database recovery where tablespaces can't be created
55 56 57 58 59

  When a pg_dump is restored, all tablespaces will attempt to be created
  in their original locations. If this fails, the user must be able to 
  adjust the restore process.

B
Add:  
Bruce Momjian 已提交
60 61 62 63 64 65 66 67 68 69 70 71
* Allow a database in tablespace t1 with tables created in tablespace t2
  to be used as a template for a new database created with default
  tablespace t2

  All objects in the default database tablespace must have default tablespace
  specifications.  This is because new databases are created by copying 
  directories.  If you mix default tablespace tables and tablespace-specified
  tables in the same directory, creating a new database from such a mixed
  directory would create a new database with tables that had incorrect 
  explicit tablespaces.  To fix this would require modifying pg_class in the
  newly copied database, which we don't currently do.

72
* Add "include file" functionality in postgresql.conf
B
Add:  
Bruce Momjian 已提交
73
* Add session start time and last statement time to pg_stat_activity
74 75
* Allow server logs to be remotely read using SQL commands
* Allow server configuration parameters to be remotely modified
B
Add:  
Bruce Momjian 已提交
76
* Allow administrators to safely terminate individual sessions
77 78 79 80 81

  Right now, SIGTERM will terminate a session, but it is treated as
  though the postmaster has paniced and shared memory might not be
  cleaned up properly.  A new signal is needed for safe termination.

B
Modify:  
Bruce Momjian 已提交
82
* Un-comment all variables in postgresql.conf
B
Bruce Momjian 已提交
83

B
Modify:  
Bruce Momjian 已提交
84 85
  By not showing commented-out variables, we discourage people from 
  thinking that re-commenting a variable returns it to its default.
86 87 88
  This has to address environment variables that are then overridden
  by config file values.  Another option is to allow commented values
  to return to their default values.
B
Bruce Momjian 已提交
89

90 91 92 93 94 95
* Allow point-in-time recovery to archive partially filled write-ahead 
  logs

  Currently only full WAL files are archived. This means that the most
  recent transactions aren't available for recovery in case of a disk
  failure.
B
Add:  
Bruce Momjian 已提交
96

B
Add:  
Bruce Momjian 已提交
97 98
* Create dump tool for write-ahead logs for use in determining
  transaction id for point-in-time recovery
B
Add:  
Bruce Momjian 已提交
99 100 101 102 103
* Set proper permissions on non-system schemas during db creation

  Currently all schemas are owned by the super-user because they are 
  copied from the template1 database.

B
Add:  
Bruce Momjian 已提交
104
* Add a function that returns the 'uptime' of the postmaster
B
Bruce Momjian 已提交
105 106
* Improve replication solutions
	o Automatic failover
107 108 109 110 111

	The proper solution to this will probably the use of a master/slave
	replication solution like Sloney and a connection pooling tool like
	pgpool.

B
Bruce Momjian 已提交
112
	o Load balancing
113 114 115 116 117

	You can use any of the master/slave replication servers to use a
	standby server for data warehousing. To allow read/write queries to
	multiple servers, you need multi-master replication like pgcluster.

B
Bruce Momjian 已提交
118
	o Allow replication over unreliable or non-persistent links
B
Add:  
Bruce Momjian 已提交
119

B
Bruce Momjian 已提交
120

121 122
Data Types
==========
B
Bruce Momjian 已提交
123 124

* Remove Money type, add money formatting for decimal type
B
Add:  
Bruce Momjian 已提交
125
* Change NUMERIC to enforce the maximum precision, and increase it
126 127
* Add function to return compressed length of TOAST data values
* Allow INET subnet tests with non-constants to be indexed
B
Update:  
Bruce Momjian 已提交
128
* Add transaction_timestamp(), statement_timestamp(), clock_timestamp() functionality
129 130 131 132 133 134 135 136 137

  Current CURRENT_TIMESTAMP returns the start time of the current
  transaction, and gettimeofday() returns the wallclock time. This will
  make time reporting more consistent and will allow reporting of
  the statement start time.

* Have sequence dependency track use of DEFAULT sequences,
  seqname.nextval (?)
* Disallow changing default expression of a SERIAL column (?)
B
Add:  
Bruce Momjian 已提交
138
* Allow infinite dates just like infinite timestamps
B
Bruce Momjian 已提交
139
* Have initdb set DateStyle based on locale?
B
Add:  
Bruce Momjian 已提交
140
* Add pg_get_acldef(), pg_get_typedefault(), and pg_get_attrdef()
141
* Allow to_char to print localized month names
B
Add:  
Bruce Momjian 已提交
142
* Allow functions to have a search path specified at creation time
B
Add:  
Bruce Momjian 已提交
143
* Allow substring/replace() to get/set bit values
B
Add:  
Bruce Momjian 已提交
144
* Add GUC variable to allow output of interval values in ISO8601 format
B
Add:  
Bruce Momjian 已提交
145
* Fix data types where equality comparison isn't intuitive, e.g. box
B
Add:  
Bruce Momjian 已提交
146 147 148 149
* Merge hardwired timezone names with the TZ database; allow either kind
  everywhere a TZ name is currently taken
* Allow customization of the known set of TZ names (generalize the
  present australian_timezones hack)
B
Add:  
Bruce Momjian 已提交
150 151
* Prevent inet cast to cidr if the unmasked bits are not zero, or
  zero bits
B
Bruce Momjian 已提交
152

153
* ARRAYS
B
Bruce Momjian 已提交
154
	o Allow nulls in arrays
B
Bruce Momjian 已提交
155
	o Allow MIN()/MAX() on arrays
B
Bruce Momjian 已提交
156
	o Delay resolution of array expression type so assignment coercion 
157
	  can be performed on empty array expressions
B
Bruce Momjian 已提交
158 159 160
	o Modify array literal representation to handle array index lower bound
	  of other than one

B
Bruce Momjian 已提交
161

B
Bruce Momjian 已提交
162
* BINARY DATA
163
	o Improve vacuum of large objects, like /contrib/vacuumlo (?)
B
Bruce Momjian 已提交
164
	o Add security checking for large objects
165 166 167 168

	Currently large objects entries do not have owners. Permissions can
	only be set at the pg_largeobject table level.

B
Bruce Momjian 已提交
169
	o Auto-delete large objects when referencing row is deleted
B
Bruce Momjian 已提交
170

171 172 173 174
	o Allow read/write into TOAST values like large objects

	This requires the TOAST column to be stored EXTERNAL.

175

176 177
Multi-Language Support
======================
B
Bruce Momjian 已提交
178

179
* Add NCHAR (as distinguished from ordinary varchar),
B
Update:  
Bruce Momjian 已提交
180
* Allow locale to be set at database creation
181 182 183 184 185 186 187 188

  Currently locale can only be set during initdb.

* Allow encoding on a per-column basis

  Right now only one encoding is allowed per database.

* Optimize locale to have minimal performance impact when not used
B
Bruce Momjian 已提交
189
* Support multiple simultaneous character sets, per SQL92
190 191 192
* Improve Unicode combined character handling (?)
* Add octet_length_server() and octet_length_client()
* Make octet_length_client() the same as octet_length()?
B
Add:  
Bruce Momjian 已提交
193

194

195 196
Views / Rules
=============
B
Bruce Momjian 已提交
197

198
* Automatically create rules on views so they are updateable, per SQL99 [view]
B
Bruce Momjian 已提交
199
* Add the functionality for WITH CHECK OPTION clause of CREATE VIEW
B
Bruce Momjian 已提交
200
* Allow NOTIFY in rules involving conditionals
B
Bruce Momjian 已提交
201
* Have views on temporary tables exist in the temporary namespace
B
Add:  
Bruce Momjian 已提交
202
* Allow temporary views on non-temporary tables
B
Bruce Momjian 已提交
203
* Allow RULE recompilation
204

B
Add:  
Bruce Momjian 已提交
205

206 207
Indexes
=======
B
Bruce Momjian 已提交
208

B
Bruce Momjian 已提交
209 210
* Allow inherited tables to inherit index, UNIQUE constraint, and primary
  key, foreign key  [inheritance]
211 212 213 214 215 216 217
* UNIQUE INDEX on base column not honored on inserts/updates from
  inherited table:  INSERT INTO inherit_table (unique_index_col) VALUES
  (dup) should fail [inheritance]

  The main difficulty with this item is the problem of creating an index
  that can spam more than one table.

B
Bruce Momjian 已提交
218
* Add UNIQUE capability to non-btree indexes
B
Bruce Momjian 已提交
219
* Add rtree index support for line, lseg, path, point
220 221 222 223 224 225
* Use indexes for MIN() and MAX()

  MIN/MAX queries can already be rewritten as SELECT col FROM tab ORDER
  BY col {DESC} LIMIT 1. Completing this item involves making this
  transformation automatically.

B
Bruce Momjian 已提交
226
* Use index to restrict rows returned by multi-key index when used with
227 228 229 230 231 232
  non-consecutive keys to reduce heap accesses

  For an index on col1,col2,col3, and a WHERE clause of col1 = 5 and
  col3 = 9, spin though the index checking for col1 and col3 matches,
  rather than just col1

B
Bruce Momjian 已提交
233
* Prevent index uniqueness checks when UPDATE does not modify the column
234 235 236 237 238 239 240 241 242 243 244

  Uniqueness (index) checks are done when updating a column even if the
  column is not modified by the UPDATE.

* Fetch heap pages matching index entries in sequential order [performance]

  Rather than randomly accessing heap pages based on index entries, mark
  heap pages needing access in a bitmap and do the lookups in sequential
  order. Another method would be to sort heap ctids matching the index
  before accessing the heap rows.

B
Update:  
Bruce Momjian 已提交
245
* Use bitmaps to combine existing indexes [performance]
246 247 248 249 250

  Bitmap indexes allow single indexed columns to be combined to
  dynamically create a composite index to match a specific query. Each
  index is a bitmap, and the bitmaps are AND'ed or OR'ed to be combined.

B
Bruce Momjian 已提交
251
* Allow use of indexes to search for NULLs
252 253 254

  One solution is to create a partial index on an IS NULL expression.

B
Reword:  
Bruce Momjian 已提交
255
* Add concurrency to GIST
B
Reword:  
Bruce Momjian 已提交
256
* Pack hash index buckets onto disk pages more efficiently
B
Bruce Momjian 已提交
257

258 259 260 261
  Currently no only one hash bucket can be stored on a page. Ideally
  several hash buckets could be stored on a single page and greater
  granularity used for the hash algorithm.

B
Bruce Momjian 已提交
262

263 264
Commands
========
B
Bruce Momjian 已提交
265

266
* Add BETWEEN ASYMMETRIC/SYMMETRIC
B
Add:  
Bruce Momjian 已提交
267
* Change LIMIT/OFFSET to use int8
B
Bruce Momjian 已提交
268
* CREATE TABLE AS can not determine column lengths from expressions [atttypmod]
269
* Allow UPDATE to handle complex aggregates [update] (?)
B
Added:  
Bruce Momjian 已提交
270
* Allow backslash handling in quoted strings to be disabled for portability
271 272 273 274

  The use of C-style backslashes (.e.g. \n, \r) in quoted strings is not
  SQL-spec compliant, so allow such handling to be disabled.

B
Bruce Momjian 已提交
275
* Allow an alias to be provided for the target table in UPDATE/DELETE
276

B
Bruce Momjian 已提交
277 278 279 280 281 282 283
  This is not SQL-spec but many DBMSs allow it.

* Allow additional tables to be specified in DELETE for joins

  UPDATE already allows this (UPDATE...FROM) but we need similar
  functionality in DELETE.  It's been agreed that the keyword should 
  be USING, to avoid anything as confusing as DELETE FROM a FROM b.
284

B
Add:  
Bruce Momjian 已提交
285
* Add CORRESPONDING BY to UNION/INTERSECT/EXCEPT
286
* Allow REINDEX to rebuild all database indexes, remove /contrib/reindex
B
Add:  
Bruce Momjian 已提交
287
* Add ROLLUP, CUBE, GROUPING SETS options to GROUP BY
288
* Add a schema option to createlang
B
Add:  
Bruce Momjian 已提交
289
* Allow UPDATE tab SET ROW (col, ...) = (...) for updating multiple columns
290
* Allow SET CONSTRAINTS to be qualified by schema/table name
B
Add:  
Bruce Momjian 已提交
291
* Allow TRUNCATE ... CASCADE/RESTRICT
B
Add:  
Bruce Momjian 已提交
292
* Allow PREPARE of cursors
293 294
* Allow PREPARE to automatically determine parameter types based on the SQL 
  statement
B
Add:  
Bruce Momjian 已提交
295 296 297 298 299 300 301 302
* Allow finer control over the caching of prepared query plans

  Currently, queries prepared via the libpq API are planned on first
  execute using the supplied parameters --- allow SQL PREPARE to do the
  same.  Also, allow control over replanning prepared queries either
  manually or automatically when statistics for execute parameters
  differ dramatically from those used during planning.

303 304 305 306 307
* Allow LISTEN/NOTIFY to store info in memory rather than tables?

  Currently LISTEN/NOTIFY information is stored in pg_listener. Storing
  such information in memory would improve performance.

B
Added:  
Bruce Momjian 已提交
308
* Dump large object comments in custom dump format
B
Bruce Momjian 已提交
309
* Add optional textual message to NOTIFY
310 311 312 313 314

  This would allow an informational message to be added to the notify
  message, perhaps indicating the row modified or other custom
  information.

B
Add:  
Bruce Momjian 已提交
315
* Allow CREATE TABLE foo (f1 INT CHECK (f1 > 0) CHECK (f1 < 10)) to work
316 317 318 319 320 321 322 323 324 325 326 327 328 329
  by searching for non-conflicting constraint names, and prefix with
  table name?
* Use more reliable method for CREATE DATABASE to get a consistent copy
  of db?

  Currently the system uses the operating system COPY command to create
  new database.

* Add C code to copy directories for use in creating new databases
* Ignore temporary tables from other sessions when processing
  inheritance?
* Have pg_ctl look at PGHOST in case it is a socket directory?
* Allow column-level GRANT/REVOKE privileges
* Add a session mode to warn about non-standard SQL usage in queries
B
Bruce Momjian 已提交
330
* Add MERGE command that does UPDATE/DELETE, or on failure, INSERT (rules, triggers?)
B
Add:  
Bruce Momjian 已提交
331
* Add ON COMMIT capability to CREATE TABLE AS SELECT
B
Add:  
Bruce Momjian 已提交
332
* Add NOVICE output level for helpful messages like automatic sequence/index creation
B
Add:  
Bruce Momjian 已提交
333 334
* Add COMMENT ON for all cluster global objects (users, groups,
  databases and tablespaces)
B
Add:  
Bruce Momjian 已提交
335 336 337 338 339
* Add an option to automatically use savepoints for each statement in a
  multi-statement transaction.

  When enabled, this would allow errors in multi-statement transactions 
  to be automatically ignored.
B
Bruce Momjian 已提交
340

B
Add:  
Bruce Momjian 已提交
341
* Make row-wise comparisons work per SQL spec
B
Add:  
Bruce Momjian 已提交
342
* Add RESET CONNECTION command to reset all session state
B
Add:  
Bruce Momjian 已提交
343

B
Add:  
Bruce Momjian 已提交
344 345 346 347
  This would include resetting of all variables (RESET ALL), dropping of
  all temporary tables, removal of any NOTIFYs, etc.  This could be used
  for connection pooling.  We could also change RESET ALL to have this
  functionality.
B
Add:  
Bruce Momjian 已提交
348

B
Bruce Momjian 已提交
349
* ALTER
350
	o Have ALTER TABLE RENAME rename SERIAL sequence names
B
Add:  
Bruce Momjian 已提交
351
	o Add ALTER DOMAIN TYPE
B
Add:  
Bruce Momjian 已提交
352
	o Allow ALTER TABLE ... ALTER CONSTRAINT ... RENAME
B
Add:  
Bruce Momjian 已提交
353
	o Allow ALTER TABLE to change constraint deferrability and actions
B
Add:  
Bruce Momjian 已提交
354
	o Disallow dropping of an inherited constraint
355 356
	o Allow objects to be moved to different schemas
	o Allow ALTER TABLESPACE to move to different directories
B
Bruce Momjian 已提交
357 358 359 360 361
	o Allow databases and schemas to be moved to different tablespaces

	One complexity is whether moving a schema should move all existing
	schema objects or just define the location for future object creation.

362 363 364 365 366
	o Allow moving system tables to other tablespaces, where possible

	Currently non-global system tables must be in the default database
	schema. Global system tables can never be moved.

B
Bruce Momjian 已提交
367

B
Bruce Momjian 已提交
368
* CLUSTER
B
Bruce Momjian 已提交
369
	o Automatically maintain clustering on a table
370

B
Bruce Momjian 已提交
371
	This might require some background daemon to maintain clustering
372
	during periods of low usage. It might also require tables to be only
B
Bruce Momjian 已提交
373 374
	paritally filled for easier reorganization.  Another idea would
        be to create a merged heap/index data file so an index lookup would
B
Update:  
Bruce Momjian 已提交
375
	automatically access the heap data too.
376

B
Add:  
Bruce Momjian 已提交
377
	o Add default clustering to system tables
B
Bruce Momjian 已提交
378

379 380 381
	To do this, determine the ideal cluster index for each system
	table and set the cluster setting during initdb.

B
Bruce Momjian 已提交
382
* COPY
383 384 385 386 387 388 389
	o Allow COPY to report error lines and continue
	
	This requires the use of a savepoint before each COPY line is
	processed, with ROLLBACK on COPY failure.

	o Allow COPY to understand \x as a hex byte
	o Have COPY return the number of rows loaded/unloaded (?)
B
Add:  
Bruce Momjian 已提交
390
	o Allow COPY to optionally include column headings as the first line
B
Bruce Momjian 已提交
391

B
Bruce Momjian 已提交
392
* CURSOR
393 394 395 396 397 398 399 400 401 402 403 404 405 406
	o Allow UPDATE/DELETE WHERE CURRENT OF cursor
	
	This requires using the row ctid to map cursor rows back to the
	original heap row. This become more complicated if WITH HOLD cursors
	are to be supported because WITH HOLD cursors have a copy of the row
	and no FOR UPDATE lock.

	o Prevent DROP TABLE from dropping a row referenced by its own open
	  cursor (?)

	o Allow pooled connections to list all open WITH HOLD cursors

	Because WITH HOLD cursors exist outside transactions, this allows
	them to be listed so they can be closed.
B
Bruce Momjian 已提交
407

B
Bruce Momjian 已提交
408
* INSERT
409
	o Allow INSERT/UPDATE of the system-generated oid value for a row
B
Bruce Momjian 已提交
410
	o Allow INSERT INTO tab (col1, ..) VALUES (val1, ..), (val2, ..)
411 412 413 414 415
	o Allow INSERT/UPDATE ... RETURNING new.col or old.col
	
	This is useful for returning the auto-generated key for an INSERT.
	One complication is how to handle rules that run as part of
	the insert.
B
Bruce Momjian 已提交
416

B
Bruce Momjian 已提交
417
* SHOW/SET
B
Bruce Momjian 已提交
418
	o Add SET PERFORMANCE_TIPS option to suggest INDEX, VACUUM, VACUUM
B
Bruce Momjian 已提交
419
	  ANALYZE, and CLUSTER
420 421 422 423 424 425 426 427
	o Add SET PATH for schemas (?)

	This is basically the same as SET search_path.
	 
	o Prevent conflicting SET options from being set

	This requires a checking function to be called after the server
	configuration file is read.
B
Bruce Momjian 已提交
428

B
Bruce Momjian 已提交
429
* SERVER-SIDE LANGUAGES
430 431 432 433
	o Allow PL/PgSQL's RAISE function to take expressions (?)

	Currently only constants are supported.

B
Bruce Momjian 已提交
434
	o Change PL/PgSQL to use palloc() instead of malloc()
435 436 437 438 439 440
	o Handle references to temporary tables that are created, destroyed, 
	  then recreated during a session, and EXECUTE is not used
	  
	This requires the cached PL/PgSQL byte code to be invalidated when
	an object referenced in the function is changed.

B
Bruce Momjian 已提交
441
	o Fix PL/pgSQL RENAME to work on variables other than OLD/NEW
442
	o Improve PL/PgSQL exception handling using savepoints
B
Bruce Momjian 已提交
443
	o Allow function parameters to be passed by name,
B
Added:  
Bruce Momjian 已提交
444
	  get_employee_salary(emp_id => 12345, tax_year => 2001)
445 446
	o Add Oracle-style packages
	o Add table function support to pltcl, plperl, plpython (?)
B
Add:  
Bruce Momjian 已提交
447
	o Allow PL/pgSQL to name columns by ordinal position, e.g. rec.(3)
B
Add:  
Bruce Momjian 已提交
448
	o Allow PL/pgSQL EXECUTE query_var INTO record_var;
B
Bruce Momjian 已提交
449
	o Add capability to create and call PROCEDURES
B
Add:  
Bruce Momjian 已提交
450
	o Allow PL/pgSQL to handle %TYPE arrays, e.g. tab.col%TYPE[]
B
Bruce Momjian 已提交
451

B
Add:  
Bruce Momjian 已提交
452

453 454
Clients
=======
B
Bruce Momjian 已提交
455

456 457 458 459 460 461
* Add XML output to pg_dump and COPY

  We already allow XML to be stored in the database, and XPath queries
  can be used on that data using /contrib/xml2. It also supports XSLT
  transformations.
    
B
Add:  
Bruce Momjian 已提交
462
* Add a libpq function to support Parse/DescribeStatement capability
463
* Prevent libpq's PQfnumber() from lowercasing the column name (?)
B
Add:  
Bruce Momjian 已提交
464 465 466 467
* Allow libpq to access SQLSTATE so pg_ctl can test for connection failure

  This would be used for checking if the server is up.

B
Bruce Momjian 已提交
468
* Have psql show current values for a sequence
B
Bruce Momjian 已提交
469
* Move psql backslash database information into the backend, use mnemonic
B
Add:  
Bruce Momjian 已提交
470
  commands? [psql]
471 472 473 474 475

  This would allow non-psql clients to pull the same information out of
  the database as psql.

* Consistently display privilege information for all objects in psql
B
Bruce Momjian 已提交
476

B
Bruce Momjian 已提交
477 478 479 480 481 482 483 484 485 486 487 488 489 490
* pg_dump
	o Have pg_dump use multi-statement transactions for INSERT dumps
	o Allow pg_dump to use multiple -t and -n switches

	  This should be done by allowing a '-t schema.table' syntax.

	o Add dumping of comments on composite type columns
	o Add dumping of comments on index columns
	o Replace crude DELETE FROM method of pg_dumpall for cleaning of
	  users and groups with separate DROP commands
	o Add dumping and restoring of LOB comments
	o Stop dumping CASCADE on DROP TYPE commands in clean mode
	o Add full object name to the tag field.  eg. for operators we need
	  '=(integer, integer)', instead of just '='.
491 492 493 494 495
	o Add pg_dumpall custom format dumps. 

	  This is probably best done by combining pg_dump and pg_dumpall 
	  into a single binary.

B
Bruce Momjian 已提交
496 497
	o Add CSV output format

B
Bruce Momjian 已提交
498 499 500 501 502 503 504 505 506 507 508
* psql tab completion

	o Provide a list of conversions after ALTER CONVERSION?
	o Support for ALTER SEQUENCE clauses
	o Add RENAME TO to ALTER TRIGGER
	o Support for ALTER USER
	o Fix ALTER (GROUP|DOMAIN|...) <sth> DROP
	o Support for ALTER LANGUAGE <sth> RENAME TO
	o Improve support for COPY
	o Improve support for ALTER TABLE

509
* ECPG (?)
M
Michael Meskes 已提交
510
	o Docs
511 512 513 514 515 516

	Document differences between ecpg and the SQL standard and
	information about the Informix-compatibility module.

	o Solve cardinality > 1 for input descriptors / variables (?)
	o Improve error handling (?)
B
Bruce Momjian 已提交
517
	o Add a semantic check level, e.g. check if a table really exists
B
Bruce Momjian 已提交
518
	o fix handling of DB attributes that are arrays
B
Bruce Momjian 已提交
519
	o Use backend PREPARE/EXECUTE facility for ecpg where possible
B
Update:  
Bruce Momjian 已提交
520
	o Implement SQLDA
M
Michael Meskes 已提交
521 522
	o Fix nested C comments
	o sqlwarn[6] should be 'W' if the PRECISION or SCALE value specified
523
	o Make SET CONNECTION thread-aware, non-standard?
524
	o Allow multidimensional arrays
B
Bruce Momjian 已提交
525

B
Bruce Momjian 已提交
526

527 528
Referential Integrity
=====================
B
Bruce Momjian 已提交
529

B
Bruce Momjian 已提交
530
* Add MATCH PARTIAL referential integrity
531 532 533 534 535 536
* Add deferred trigger queue file

  Right now all deferred trigger information is stored in backend
  memory.  This could exhaust memory for very large trigger queues.
  This item involves dumping large queues into files.

B
Bruce Momjian 已提交
537 538 539 540 541 542 543 544
* Implement dirty reads or shared row locks and use them in RI triggers

  Adding shared locks requires recording the table/rows numbers in a 
  shared area, and this could potentially be a large amount of data.
  One idea is to store the table/row numbers in a separate table and set
  a bit on the row indicating looking in this new table is required to
  find any shared row locks.

B
Bruce Momjian 已提交
545
* Enforce referential integrity for system tables
B
Bruce Momjian 已提交
546
* Change foreign key constraint for array -> element to mean element
547 548
  in array (?)
* Allow DEFERRABLE UNIQUE constraints (?)
B
Add:  
Bruce Momjian 已提交
549
* Allow triggers to be disabled [trigger]
550 551 552 553

  Currently the only way to disable triggers is to modify the system
  tables.

554
* With disabled triggers, allow pg_dump to use ALTER TABLE ADD FOREIGN KEY
555 556 557 558

  If the dump is known to be valid, allow foreign keys to be added
  without revalidating the data.

B
Bruce Momjian 已提交
559
* Allow statement-level triggers to access modified rows
560
* Support triggers on columns
B
Add:  
Bruce Momjian 已提交
561
* Remove CREATE CONSTRAINT TRIGGER
562 563 564 565

  This was used in older releases to dump referential integrity
  constraints.

B
Add:  
Bruce Momjian 已提交
566
* Allow AFTER triggers on system tables
B
Add:  
Bruce Momjian 已提交
567

568 569 570 571 572
  System tables are modified in many places in the backend without going
  through the executor and therefore not causing triggers to fire. To
  complete this item, the functions that modify system tables will have
  to fire triggers.

B
Bruce Momjian 已提交
573

574 575
Dependency Checking
===================
B
Bruce Momjian 已提交
576

577
* Flush cached query plans when the dependent objects change
B
Add:  
Bruce Momjian 已提交
578
* Track dependencies in function bodies and recompile/invalidate
579

B
Add:  
Bruce Momjian 已提交
580

581 582
Exotic Features
===============
583

584 585 586 587 588 589 590 591
* Add SQL99 WITH clause to SELECT
* Add SQL99 WITH RECURSIVE to SELECT
* Add pre-parsing phase that converts non-ANSI syntax to supported
  syntax

  This could allow SQL written for other databases to run without
  modification.

B
Bruce Momjian 已提交
592
* Allow plug-in modules to emulate features from other databases
B
Bruce Momjian 已提交
593
* SQL*Net listener that makes PostgreSQL appear as an Oracle database
B
Bruce Momjian 已提交
594
  to clients
595 596 597 598 599 600 601 602 603 604 605 606
* Allow queries across databases or servers with transaction
  semantics
	
  Right now contrib/dblink can be used to issue such queries except it
  does not have locking or transaction semantics. Two-phase commit is
  needed to enable transaction semantics.

* Add two-phase commit

  This will involve adding a way to respond to commit failure by either
  taking the server into offline/readonly mode or notifying the
  administrator
607

B
Bruce Momjian 已提交
608

B
Bruce Momjian 已提交
609
PERFORMANCE
610 611
===========

B
Bruce Momjian 已提交
612

613 614
Fsync
=====
B
Bruce Momjian 已提交
615

616
* Improve commit_delay handling to reduce fsync()
B
Bruce Momjian 已提交
617
* Determine optimal fdatasync/fsync, O_SYNC/O_DSYNC options
618 619
* Allow multiple blocks to be written to WAL with one write()
* Add an option to sync() before fsync()'ing checkpoint files
B
Bruce Momjian 已提交
620

B
Bruce Momjian 已提交
621

622 623
Cache
=====
B
Bruce Momjian 已提交
624
* Add free-behind capability for large sequential scans [fadvise]
B
Bruce Momjian 已提交
625
* Consider use of open/fcntl(O_DIRECT) to minimize OS caching
626 627 628 629 630 631 632 633 634 635 636 637 638
* Cache last known per-tuple offsets to speed long tuple access

  While column offsets are already cached, the cache can not be used if
  the tuple has NULLs or TOAST columns because these values change the
  typical column offsets. Caching of such offsets could be accomplished
  by remembering the previous offsets and use them again if the row has
  the same pattern.

* Speed up COUNT(*)

  We could use a fixed row count and a +/- count to follow MVCC
  visibility rules, or a single cached value could be used and
  invalidated if anyone modifies the table. [count]
B
Bruce Momjian 已提交
639

B
Add:  
Bruce Momjian 已提交
640 641 642 643 644
* Consider automatic caching of queries at various levels:
	o Parsed query tree
	o Query execute plan
	o Query results

645

646 647
Vacuum
======
B
Bruce Momjian 已提交
648

649 650 651 652 653
* Improve speed with indexes

  For large table adjustements during vacuum, it is faster to reindex
  rather than update the index.

B
Bruce Momjian 已提交
654
* Reduce lock time by moving tuples with read lock, then write
B
Bruce Momjian 已提交
655
  lock and truncate table
656 657 658 659 660

  Moved tuples are invisible to other backends so they don't require a
  write lock. However, the read lock promotion to write lock could lead
  to deadlock situations.

B
Add:  
Bruce Momjian 已提交
661
* Allow free space map to be auto-sized or warn when it is too small
662 663 664 665 666 667 668

  The free space map is in shared memory so resizing is difficult.

* Maintain a map of recently-expired rows

  This allows vacuum to reclaim free space without requiring
  a sequential scan
B
Add:  
Bruce Momjian 已提交
669

B
Add:  
Bruce Momjian 已提交
670

671 672
Locking
=======
673 674

* Make locking of shared data structures more fine-grained
675 676 677 678

  This requires that more locks be acquired but this would reduce lock
  contention, improving concurrency.

679
* Add code to detect an SMP machine and handle spinlocks accordingly
B
Bruce Momjian 已提交
680 681
  from distributted.net, http://www1.distributed.net/source, 
  in client/common/cpucheck.cpp
682 683 684 685 686 687 688 689 690 691 692

  On SMP machines, it is possible that locks might be released shortly,
  while on non-SMP machines, the backend should sleep so the process
  holding the lock can complete and release it.

* Improve SMP performance on i386 machines

  i386-based SMP machines can generate excessive context switching
  caused by lock failure in high concurrency situations. This may be
  caused by CPU cache line invalidation inefficiencies.

693 694
* Research use of sched_yield() for spinlock acquisition failure

695

696 697
Startup Time
============
B
Bruce Momjian 已提交
698

B
Bruce Momjian 已提交
699
* Experiment with multi-threaded backend [thread]
700 701 702 703 704 705

  This would prevent the overhead associated with process creation. Most
  operating systems have trivial process creation time compared to
  database startup overhead, but a few operating systems (WIn32,
  Solaris) might benefit from threading.

B
Bruce Momjian 已提交
706
* Add connection pooling [pool]
707 708 709 710

  It is unclear if this should be done inside the backend code or done
  by something external like pgpool. The passing of file descriptors to
  existing backends is one of the difficulties with a backend approach.
711

712

713 714
Write-Ahead Log
===============
715

716 717 718 719
* Eliminate need to write full pages to WAL before page modification [wal]

  Currently, to protect against partial disk page writes, we write the
  full page images to WAL before they are modified so we can correct any
720 721
  partial page writes during recovery.  These pages can also be
  eliminated from point-in-time archive files.
722 723 724 725 726 727 728

* Reduce WAL traffic so only modified values are written rather than
  entire rows (?)
* Turn off after-change writes if fsync is disabled

  If fsync is off, there is no purpose in writing full pages to WAL

B
Bruce Momjian 已提交
729
* Add WAL index reliability improvement to non-btree indexes
730 731 732
* Allow the pg_xlog directory location to be specified during initdb
  with a symlink back to the /data location

B
Add:  
Bruce Momjian 已提交
733
* Allow WAL information to recover corrupted pg_controldata
B
Added:  
Bruce Momjian 已提交
734 735
* Find a way to reduce rotational delay when repeatedly writing
  last WAL page
736 737 738 739
  
  Currently fsync of WAL requires the disk platter to perform a full
  rotation to fsync again. One idea is to write the WAL to different
  offsets that might reduce the rotational delay.
740

B
Add:  
Bruce Momjian 已提交
741 742 743 744 745 746 747 748 749
* Allow buffered WAL writes and fsync

  Instead of guaranteeing recovery of all committed transactions, this
  would provide improved performance by delaying WAL writes and fsync
  so an abrupt operating system restart might lose a few seconds of 
  committed transactions but still be consistent.  We could perhaps
  remove the 'fsync' parameter (which results in an an inconsistent
  database) in favor of this capability.

B
Bruce Momjian 已提交
750

751 752
Optimizer / Executor
====================
753

754 755 756 757 758 759 760 761
* Add missing optimizer selectivities for date, r-tree, etc
* Allow ORDER BY ... LIMIT 1 to select high/low value without sort or
  index using a sequential scan for highest/lowest values

  If only one value is needed, there is no need to sort the entire
  table. Instead a sequential scan could get the matching value.

* Precompile SQL functions to avoid overhead
B
Add:  
Bruce Momjian 已提交
762
* Add utility to compute accurate random_page_cost value
B
Bruce Momjian 已提交
763
* Improve ability to display optimizer analysis using OPTIMIZER_DEBUG
B
Update:  
Bruce Momjian 已提交
764
* Allow sorting, temp files, temp tables to use multiple work directories
765 766

  This allows the I/O load to be spread across multiple disk drives.
B
Add:  
Bruce Momjian 已提交
767
* Have EXPLAIN ANALYZE highlight poor optimizer estimates
768 769 770 771 772
* Use CHECK constraints to influence optimizer decisions

  CHECK constraints contain information about the distribution of values
  within the table. This is also useful for implementing subtables where
  a tables content is distributed across several subtables.
B
Add:  
Bruce Momjian 已提交
773 774 775
* Consider using hash buckets to do DISTINCT, rather than sorting

  This would be beneficial when there are few distinct values.
B
Bruce Momjian 已提交
776

B
Add:  
Bruce Momjian 已提交
777

778 779
Miscellaneous
=============
780 781

* Do async I/O for faster random read-ahead of data
782 783 784 785

  Async I/O allows multiple I/O requests to be sent to the disk with
  results coming back asynchronously.
    
786
* Use mmap() rather than SYSV shared memory or to write WAL files (?) [mmap]
787 788 789 790 791

  This would remove the requirement for SYSV SHM but would introduce
  portability issues. Anonymous mmap is required to prevent I/O
  overhead.

B
Add:  
Bruce Momjian 已提交
792
* Add a script to ask system configuration questions and tune postgresql.conf
B
Add:  
Bruce Momjian 已提交
793 794
* Use a phantom command counter for nested subtransactions to reduce
  tuple overhead
B
Add:  
Bruce Momjian 已提交
795 796 797 798 799 800
* Consider parallel processing a single query

  This would involve using multiple threads or processes to do optimization, 
  sorting, or execution of single query.  The major advantage of such a 
  feature would be to allow multiple CPUs to work together to process a 
  single query.
B
Add:  
Bruce Momjian 已提交
801

802

803
Source Code
804 805
===========

B
Bruce Momjian 已提交
806
* Add use of 'const' for variables in source tree
B
Bruce Momjian 已提交
807
* Rename some /contrib modules from pg* to pg_*
B
Bruce Momjian 已提交
808
* Move some things from /contrib into main tree
B
Bruce Momjian 已提交
809
* Remove warnings created by -Wcast-align
B
Bruce Momjian 已提交
810
* Move platform-specific ps status display info from ps_status.c to ports
B
Typo.  
Bruce Momjian 已提交
811
* Improve access-permissions check on data directory in Cygwin (Tom)
B
Bruce Momjian 已提交
812
* Add optional CRC checksum to heap and index pages
B
Add:  
Bruce Momjian 已提交
813
* Clarify use of 'application' and 'command' tags in SGML docs
B
Bruce Momjian 已提交
814
* Better document ability to build only certain interfaces (Marc)
815
* Remove or relicense modules that are not under the BSD license, if possible
816
* Remove memory/file descriptor freeing before ereport(ERROR)
B
Add:  
Bruce Momjian 已提交
817
* Acquire lock on a relation before building a relcache entry for it
B
Add:  
Bruce Momjian 已提交
818
* Research interaction of setitimer() and sleep() used by statement_timeout
B
Add:  
Bruce Momjian 已提交
819
* Rename /scripts directory because they are all C programs now
B
Add:  
Bruce Momjian 已提交
820
* Promote debug_query_string into a server-side function current_query()
B
Add:  
Bruce Momjian 已提交
821
* Allow the identifier length to be increased via a configure option
B
Add:  
Bruce Momjian 已提交
822
* Allow binaries to be statically linked so they are more easily relocated
B
Add:  
Bruce Momjian 已提交
823
* Move some /contrib modules out to their own project sites
B
Add:  
Bruce Momjian 已提交
824
* Remove Win32 rename/unlink looping if unnecessary
B
Add:  
Bruce Momjian 已提交
825

826 827 828 829 830 831 832 833 834
* Win32
	o Remove per-backend parameter file and move into shared memory?
	o Remove configure.in check for link failure when cause is found
	o Remove readdir() errno patch when runtime/mingwex/dirent.c rev
	  1.4 is released
	o Remove psql newline patch when we find out why mingw outputs an
	  extra newline
	o Allow psql to use readline once non-US code pages work with
	  backslashes
B
Add:  
Bruce Momjian 已提交
835 836
	o Re-enable timezone output on log_line_prefix '%t' when a
	  shorter timezone string is available
837

B
Add:  
Bruce Momjian 已提交
838
* Wire Protocol Changes
839
	o Allow dynamic character set handling
B
Add:  
Bruce Momjian 已提交
840
	o Add decoded type, length, precision
841
	o Use compression?
B
Bruce Momjian 已提交
842 843
	o Update clients to use data types, typmod, schema.table.column names of
	  result sets using new query protocol
B
Add:  
Bruce Momjian 已提交
844

845

B
Bruce Momjian 已提交
846 847 848 849 850
---------------------------------------------------------------------------


Developers who have claimed items are:
--------------------------------------
B
Bruce Momjian 已提交
851
* Alvaro is Alvaro Herrera <alvherre@dcc.uchile.cl>
B
Bruce Momjian 已提交
852
* Andrew is Andrew Dunstan <andrew@dunslane.net>
B
Bruce Momjian 已提交
853 854 855
* Bruce is Bruce Momjian <pgman@candle.pha.pa.us> of Software Research Assoc.
* Christopher is Christopher Kings-Lynne <chriskl@familyhealth.com.au> of
    Family Health Network
B
Bruce Momjian 已提交
856
* Claudio is Claudio Natoli <claudio.natoli@memetrics.com>
B
Bruce Momjian 已提交
857
* D'Arcy is D'Arcy J.M. Cain <darcy@druid.net> of The Cain Gang Ltd.
B
Bruce Momjian 已提交
858
* Fabien is Fabien Coelho <coelho@cri.ensmp.fr>
B
Bruce Momjian 已提交
859 860
* Gavin is Gavin Sherry <swm@linuxworld.com.au> of Alcove Systems Engineering
* Greg is Greg Sabino Mullane <greg@turnstep.com>
B
Bruce Momjian 已提交
861
* Hiroshi is Hiroshi Inoue <Inoue@tpf.co.jp>
B
Bruce Momjian 已提交
862
* Jan is Jan Wieck <JanWieck@Yahoo.com> of Afilias, Inc.
B
Bruce Momjian 已提交
863
* Joe is Joe Conway <mail@joeconway.com>
864 865
* Karel is Karel Zak <zakkr@zf.jcu.cz>
* Kris is Kris Jurka 
B
Fix :  
Bruce Momjian 已提交
866
* Magnus is Magnus Hagander <mha@sollentuna.net>
B
Bruce Momjian 已提交
867
* Marc is Marc Fournier <scrappy@hub.org> of PostgreSQL, Inc.
B
Bruce Momjian 已提交
868
* Matthew T. O'Connor <matthew@zeut.net>
B
Bruce Momjian 已提交
869
* Michael is Michael Meskes <meskes@postgresql.org> of Credativ
B
Bruce Momjian 已提交
870
* Neil is Neil Conway <neilc@samurai.com>
B
Bruce Momjian 已提交
871
* Oleg is Oleg Bartunov <oleg@sai.msu.su>
872
* Peter is Peter Eisentraut <peter_e@gmx.net>
B
Bruce Momjian 已提交
873
* Philip is Philip Warner <pjw@rhyme.com.au> of Albatross Consulting Pty. Ltd.
B
Bruce Momjian 已提交
874
* Rod is Rod Taylor <pg@rbt.ca>
875
* Simon is Simon Riggs
B
Bruce Momjian 已提交
876
* Stephan is Stephan Szabo <sszabo@megazone23.bigpanda.com>
B
Bruce Momjian 已提交
877
* Tatsuo is Tatsuo Ishii <t-ishii@sra.co.jp> of Software Research Assoc.
878
* Teodor is 
B
Bruce Momjian 已提交
879
* Tom is Tom Lane <tgl@sss.pgh.pa.us> of Red Hat