ENV ATTRIBUTES FOR DEV SERVER: useage: export ATTR=1 LOCALHOST_SOCKET - diverts slide labels to scripts/test_scripts/socket.pl (START IT 1ST) USE_FILE_SESSIONS - uses file-system directory instead of sessions table USE_DB_SESSIONS - uses sessions table instead of file-system directory OVERRIDE_LOCK - prevents record being 'locked' by request status HTTP_REPORT - returns report as web-page instead of PDF RDBO_DEBUG_ON - force RDBO queries to stdout (eg test scripts) SMTP_TEST - dumps message content to logs/mail.test instead of using SMTP out DEBUG_ON - use in test suite to dump application debug info to console CURRENT ISSUES: Jul/2011: KNOWN ISSUE - sessions leaking in CGI v3.43 or less. Fixed in 3.44, BUT url handling changed!!! self_url() & path_info() apparently did not return query params - SEE DOCS under mod_perl (only) report function issues rollback on request_report table insert in M::Report::update_report(). remove Apache::DBI and issue goes away, but get 1 -2 new db conenctions for every new web request. override dbi_connect() in LIMS::DB and issue also goes away, but get error if a transaction fails (eg duplicate UK): rollback ineffective with AutoCommit enabled at /home/raj/perl5/lib/perl5/Rose/DB.pm line 1208. set autocommit to 0 and some db edits fail IDENTIFIED PROBLEM IN M::Roles::RequestUpdate::update_request_status() - APPEARS TO BE DUE TO LIMS::DB::StatusOption->new() ACTION, AND IS FIXED IF TRANSACTION DBH IS USED. Other actions causing same failure in same transaction: LIMS::DB::AdditionalOption::Manager->get_additional_options in do_additional_options() LIMS::DB::RequestLabTestStatus::Manager->get_request_lab_test_status() in has_outstanding_tests() LIMS::DB::StatusOption->new() in _is_authorisation_active() # patching using git: If you want to create a patch file via "git diff" that can be applied using "patch -p0 < patchfile" use the following command: git diff --no-prefix > patchfile then apply the patch: patch -p0 < patchfile If you have an existing "git diff" patch file that was created without the "--no-prefix" option, you can apply that patch via: patch -p1 < patchfile this will ignore the default a/ b/ source prefixes. # from #rdbo (26/3/2010): 14:08 < siracusa> here's what I think is happening 14:08 < siracusa> when you don't explicitly supply a db object, RDBO calls init_db() to make one 14:08 < siracusa> and init_db() eventually leads to DBI->connect() being called 14:08 < siracusa> and under Apache::DBI, DBI->connect looks first in its cache of database handles that are already connected 14:08 < siracusa> it finds an already-connected handle 14:09 < siracusa> but Apache::DBI also resets all the handle attributes to their original values before returning its cached $dbh 14:09 < siracusa> and teh original value for AutoCommit was 1 14:10 < siracusa> so it takes this $dbh which, unbeknownst to it, is still being used in an outstanding transaction 14:10 < siracusa> and sets its AutoCommit to 1 14:10 < siracusa> which apparently angers the transaction in flight and causes the weird rollback issues 14:10 < siracusa> it's always best/safest to explicitly share a db object during the course of a transaction 14:11 < siracusa> which avoids situations like this where Apache::DBI is handing out your transaction $dbh to other objects and resetting its attributes when it does *********** so solution is to use same shared dbh throughout transaction ************** Template name generation CAT::TT default is LIMS/App/runmode.tmpl overridden in tt_config using TEMPLATE_NAME_GENERATOR - generates app/runmode.tt, but only works if runmode is requested, not forwarded. Automatic template generation for forwarded rm's is handled by LIMS::get_template_name DBH cgiapp_init() uses LIMS::DB->new->retain_dbh to initialise $self->dbh_config LIMS::RDBO init_db() returns LIMS::DB->new_or_cached They are not the same dbh as $dbi->{Profile} = DBI::Profile->new set in cgiapp_init prints login sql to console, but rest of sql calls by RDBO are not. Can set $dbh->{Profile} in LIMS::RDBO but sql never output. Seems to depend on whether new_or_cached set, and whether retain_dbh used. Might be mis-using db connections: [Dispatch] ERROR' for request '/hmds/admin/lab_section': Error executing class callback in init stage: DBI connect('database=hmds_lims;host=localhost','raj',...) failed: Too many connections at /home/raj/perl5/lib/perl5/Rose/DB.pm line 887 SHOW PROCESSLIST shows sleeping processes increasing for each request, under lims_server (not mod_perl). Re-start lims_server resets to 0. Have set wait_timeout = 120 in my.cnf until this is fixed. FIXED - need to call new_or_cached->retain_dbh instead of new->retain_dbh in cgiapp_init Transactions: If using RDBO do_transaction(), methods in anon sub MUST use same db as parent method - see: http://groups.google.com/group/rose-db-object/browse_thread/thread/a30231b7c0be219d Sub-selects: 1) 'request_report.request_id' => { eq => undef }, with_objects => 'request_report' 2) my $subselect = q!NOT EXISTS (SELECT request_id FROM request_report rr WHERE rr.request_id = id)!; $data = RBDO::Manager->get_objects( clauses => [ $subselect ] ); DBH sharing - might be dangerous in commit/roll-back situations where rollback undoes previous commits in unrelated sections of code - see http://thread.gmane.org/gmane.comp.lang.perl.modules.dbi.rose-db-object/2570/focus=2575 might be safer to use new dbh for transactions. Database selection in LIMS::DB defaults to test - overridden in lims_server.pl and mod_perl config using env variable ROSEDB_DEVINIT which points to config/rosedb_devinit_[devel|prod].pl which uses modify_db() method to change db to devel/production. dbi_connect returns DBIx::Log4perl enabled dbh if ROSEDB_DEVINIT flag set, so we don't get t/ files dumping sql to console. Variable persistence: Using CAD::Server, passing id in url eg /admin/update/2 and retrieving via $data->{id} = $self->param('id') causes value to persist across subsequent requests, so if next request is to generate new record, previous id is retained and record gets updated with new data instead of creating new record - safer to hand id in hidden param in form. CA::Server & mod_perl don't suffer from this. FIXED - use CA::Server instead. mod_perl or fastcgi: See 'is my app caching db connection ?' in cgiapp list for issues regarding FastCGI and transactions: Incidentally, I hope you have something in there to catch errors at the top level of your FastCGI adapter and issue a rollback on any open database handles. If you don't, you might leave some partially completed uncommitted data around that the next request would commit. Aoache::DBI solves this for mod_perl by doing a rollback on all open connections after every request, in case the request exited abnormally. Issue using non-external fastcgi (ie FastCgiServer) - FCGI.pm (in this context ony - doesn't affect external fastcgi) redefines the warn handler set in LIMS::Local::QueryLog, so SQL statements get written to Apache error log. Solution is to use external fastcgi, or call L::L::Q::ensure_warn_handler_capture() somewhere in app (eg cgiapp_prerun), which forces L::L::Q::_warn_handler() method Debug: $self->debug( scalar, arrayref, hashref, obj or subroutine ref; followed by optional number 1 ..7) - uses Log::Dispatch either via CAP::LogDispatch or LIMS::LogDispatch - setup at top of LIMS.pm If using LIMS::LogDispatch, $self->log_dispatch->log(message => sub{Dumper $foo}, level => 'bar') also works - use for expensive ops like Data::Dumper expansion of object, which may be discarded if log level too low. TODO - integrate with debug() - need to test for presence of subroutine in args Config: Files in config directory labelled lims_*.pl are automatically loaded in LIMS::Dispatch RBDO errors: Cannot load MyApp::DB::Foo without a primary key (id) with a non-null value or another unique key with at least one non-null value - creating a new record on a table with no unique keys (except PK), using MyApp::DB::Foo->new(%data)->insert_or_update() - it can't - behaviour fixed in 0.775 - see ChangeLog ErrorHandler: LIMS::Local::ErrorHandler uses a $SIG{__DIE__} handler which interfers with CAP::Redirect (see http://www.mail-archive.com/cgiapp@lists.erlbaum.net/msg05184.html) Copied CAP::Redirect function into LIMS::Base::redirect(), omitting eval block causing problem with SIG{__DIE__} Works under test_harness & mod_perl but not fastcgi - get std server error msg capture SIGDIE in test harness mode: export DEBUG_ON=1; perl -Ilib -e '$SIG{__DIE__} = sub { warn $_[0]; die $_[0]; }; do "t/test.t";' New db tables: SQL to setup/lims.sql, any dependency data to setup/data.sql. Test db creation in rebuild.pl - set db to test or lims_scratch. Generate DB classes with script/make_classes.pl -> setup/classes.pl -> DB/Foo.pm MySQL binary logfiles: To turn off log-bin, edit /etc/mysql/my.cnf and comment out log-bin: #log-bin = /var/log/mysql/mysql-bin.log This will save 100MBs of space if you have a fast insert going on. You also have to comment out the following if you comment out log-bin or mysqld will not start: #expire_logs_days = 10 Autosuggest js: bsn.Autosuggest.jQuery.js is a compressed version of bsn.Autosuggest_2.1.3.js, with true/false changes made to 'onKeyPress bubble', so that 'return/enter' keypress just selects from list & doesn't submit form - see last posting by Igor - http://www.brandspankingnew.net/archive/2007/02/ajax_auto_suggest_v2.html DFV messages: see: http://sourceforge.net/mailarchive/forum.php?thread_name=20080108163239.GA12455%40apartia.fr&forum_name=cascade-dataform The 'msgs' hashref refers to constraint names, not field names. For this to work, you have to call the "name_this" method inside of the custom FV_URI_HTTP method. HTMLDOC: from wdir: sh .configure --prefix=/home/raj/perl-lib/htmldoc; make; make install ln -s /home/raj/www/perl-lib/htmldoc/bin/htmldoc /usr/local/bin/htmldoc; cpan HTML::HTMLDoc ASPELL: need to apt-get install aspell-en if not aleady installed Win32 - see http://www.nosq.com/blog/2005/07/aspell-0603-for-win32/ svk: svk mirror http://address.of.repo //mirror/mirror_name svk sync //mirror/mirror_name svk cp //mirror/hmds_lims/trunk //mirror/hmds_lims/branches/foo -m 'creating branch for version 0.01' then, from root dir: svk up -s svk cp //mirror/hmds_lims/trunk //mirror/hmds_lims/tags/0.01 -m 'tagging version 0.01' svk mirror --detach //mirror/hmds-lims svk co --purge svk checkout --list svk checkout --relocate //mirror/mirror_name /path/to/new/location svk mirror //mirror/hmds_lims https://www.jti.org.uk/svn/hmds_lims to merge trunk & branches: cd app/branches/foo; svk push; cd app/trunk; svk up -s 'svk pull' in your branch pulls all changes from trunk down to your branch Moose: use Moose; extends foo; works in Model classes, but in all Controller classes, get: Invalid CODE attribute: StartRunmode OR: can't locate object method 'add_callback' in RunmodeDeclare (if using Sugar) REQUEST STATUS: new request automatically gets status_option_id 1 (new) - 'requests' table default value screening -> status_option_id 2 (screened) reporting: if 'authorise' status_option inactive and no outstanding tests, status_option_id = 5 (completed) else status_option_id = 3 (reported) authorising (available in template only if request reported & 'authorise' option is active): if no oustanding tests, status_option_id = 5 (completed) else status_option_id = 4 (authorised) final_diagnosis - tmpl param enabled if request authorised (or reported if 'authorise' option inactive) AND status NOT complete AND no outstanding tests: status_option_id = 5 (completed) new lab_tests -> reverts status_option to <5 (complete) if appropriate EMAIL ALERT RULES: 1) Authorised & status = new / relapse & have e-mail contact (overriden for age / PNH) 2) test = TBCulture & diagnosis = 'Granulomatous inflammation' & LTH case 3) special rules for diagnosis = 'DLBCL or Burkitt lymphoma - further tests pending' DateTime: Unfortunately, DateTime does not seem to provide a good way to set the default stringification format for DateTime objects. A hack to do that would be to put this code somewhere in your app: use DateTime; no warnings 'redefine'; sub DateTime::_stringify { shift->strftime('%Y-%m-%d %H:%M:%S') } Then all DateTime objects will stringify "without the T" everywhere in your code, yielding: $dt = $user->expires; # a DateTime object, but... print $dt; # prints a string like "2003-12-31 12:34:56" -- no "T"! Transfer mysql backup files to new server: sync -e ssh -varuzP ./full-backup_2013-* 163.160.171.48:/backups/mysql/