[FX.php List] Slightly confused and need a push, please

Fri Jun 10 01:27:04 MDT 2005

Derek,

In the implementations I did, I have a dedicated machine (the Reporter) with
FM Client next to the FMServer to get and process the files and perform all
kind of other tasks, like reporting.

On the unix box the files are put in some kind of mailbox (FTP folder).
Triggered by Troi Activator (every hour or faster) the FM machine compares
the unix mailbox with its own processing folder in the first cycle and
retrieves the files that are new (with CNS-FTPit).
Then in the next cycle it will process the new files, create the records in
FM and move the files to the processed folder (with Troi-File).

A Cron job in the unix box deletes the files older than, say, 1 week. This
is to keep the mailbox small to minimize the comparison time.
You can also give the FTP user deletion rights on the unix box and delete
the processed files, e.g. in the 3rd cycle.

If you need more info, you can also mail me off-list.

Johan Visser, BPA Services
bpa.services at zonnet.nl

-----Oorspronkelijk bericht-----
Van: fx.php_list-bounces at mail.iviking.org
[mailto:fx.php_list-bounces at mail.iviking.org]Namens Derek Bastille
Verzonden: donderdag 9 juni 2005 21:01
Aan: FX.php Discussion List
Onderwerp: Re: [FX.php List] Slightly confused and need a push, please

Hi John,
   Thanks for the suggestion.  It is similar to one of the possibilities
I was considering:
- the daily job files get rolled up on the main systems
- a cron job then copies the job files to the FMPro server system via
scp
- another cron job on the server fires to convert the files and feed
them to FMPro

   This could work, but the timing of the two scripts can be a problem.
That is, I've had problems in the past where the Cray's job accounting
scripts got delayed past when the transfer was supposed to happen and
my scripts have missed/duplicated the usage data.  So basically, I'd
like the import to be a push process where each of the other systems
formats the data and submits it to a URL on the FileMaker server.  This
way there is only one timed script to worry about.
   That's why I'm looking in to a way to build a post to FX.php or
directly to server advanced.  On the other hand, though, it seems like
your solution would allow me to import a whole job file (typically
consisting of 100 to 200 job records) instead of feeding the database
one record at a time.  Hmmm...

Regards,
   Derek

On Jun 8, 2005, at 10:01 PM, Johan Visser wrote:

> Derek,
>
> I.o. XML formatting the file, did you consider FTP-ing the unaltered
> usage
> file from the Unix machine with FTPit and process it with Troi-File.
> That's how I normally process transaction files.
>
> Johan Visser
> BPA Services
>
> -----Oorspronkelijk bericht-----
> Van: fx.php_list-bounces at mail.iviking.org
> [mailto:fx.php_list-bounces at mail.iviking.org]Namens Derek Bastille
> Verzonden: donderdag 9 juni 2005 2:54
> Aan: FX.php Discussion List
> Onderwerp: [FX.php List] Slightly confused and need a push, please
>
>
> Hi All,
>    I hope that this is not too much of a simple question.  I may have
> gotten myself overly confused enough by going through several books/web
> sites  :-P
>
>    Anyway, I have a Unix system that is generating usage statistics.
> Each job record is one line of a text file that is produced each day:
>
> single::group1:elson:4:142732:142739:7::570928:562504:1.000:0.250:
> 30296:050429 at 083449:jsplit
> ...
>
>    I have a corresponding FMPRo 7 database that is being hosted by
> Server Advanced that I have previously been manually
> converting/importing the file into.  What I'd like to do is to set up
> an automated job on the Unix system that runs each day's file through a
> perl formatting script and then posts it to the server via cURL.
>
>    I've gone through the various FX.php and FMPro7 SA documents and am
> really torn as to which is the best way to approach this:
>
> -- convert the file to an XML file and then send it directly to FMPRo7
> SA?
> -- create an FX.php script that takes a request and then it does the
> post to FMPro?
>
>    In either case, the difficulty is in how to best get the formatted
> data from the Unix system to the right place on the server.  I could
> use a 'curl -F filename http://blah/foo.php' but how should I format
> the file?
>
>    If there is a website or other RTFM that I should know about, that
> would be great.  Otherwise, any pointers on which way I should start
> moving would be really helpful.  Thanks!
>
> Derek
>
>
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
                         Derek Bastille | Phone: (907)450-8643
     PO Box 756020, Fairbanks AK, 99775 | Fax:   (907)450-8601
    Arctic Region Supercomputing Center | email: bastille at arsc.edu
User Services Consultant/ISSO-Accounts |        fndlb at uaf.edu
      PGP public key: http://www.arsc.edu/~bastille/dereksKey.txt
----------------------------------------------------------------------
     ARSC Help Desk:  email: consult at arsc.edu  voice: (907)450-8602
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
FX.php_List mailing list
FX.php_List at mail.iviking.org
http://www.iviking.org/mailman/listinfo/fx.php_list