Deploy and Run ATK App on TAP¶
Installing Required Packages¶
Install “golang” from the package manager¶
On RedHat/CentOS, ensure “EPEL” repo is enabled. For more information, see Yum Repo.
From the command line interface (terminal), install the “go” language and the required libraries.
$ sudo yum install golang
To read more about “go” see https://golang.org/ . To test the “go” installation:
$ go version
go version go1.4.2 linux/amd64
Install the CloudFoundry CLI package:
$ wget --content-disposition https://cli.run.pivotal.io/stable?release=redhat64
This downloads the prepackaged RPM to your local machine. Install this package:
$ sudo yum install cf-cli_amd64.rpm
Note
See https://github.com/cloudfoundry/cli/releases for installation on a system not running RedHat/CentOS.
Test the package installation:
$ cf --version
cf version 6.11.2-2a26d55-2015-04-27T21:11:44+00:00
Setting Up CF for ATK Deployment¶
First, add the <CLOUD_FOUNDRY_API_ENDPOINT> to the “no_proxy” list.
Now run cf api <CLOUD_FOUNDRY_API_ENDPOINT> -skip-ssl-validation to set your API endpoint.
You should see a message like this:
$ cf api my_endpoint -skip-ssl-validation
Setting api endpoint to my_endpoint...
OK
API endpoint: my_endpoint (API version: 2.25.0)
Not logged in. Use 'cf login' to log in.
Now try login by running the command cf login -u <CLOUD_FOUNDRY_USERNAME> -p <CLOUD_FOUNDRY_PASSWORD> -o <CLOUD_FOUNDRY_ORGANIZATION > -s <CLOUD_FOUNDRY_SPACE>
Your output should look something like this:
$ cf login -u my_name -p my_password -o my_org -s my_space
API endpoint: my_endpoint
Authenticating...
OK
Targeted org my_org
Targeted space my_space
API endpoint: my_endpoint (API version: 2.25.0)
User: my_name
Org: my_org
Space: my_space
Verify that you are still connected by running “cf target” And your output looks like this:
$ cf target
API endpoint: my_endpoint (API version: 2.25.0)
User: my_name
Org: my_org
Space: my_space
Prepare ATK Tarball¶
For QA:
ATK tarballs are built as part of the TeamCity build and are uploaded to S3. In order to download the file, simply run the command:
wget https://s3.amazonaws.com/gao-internal-archive/<Your_Branch_Name>/trustedanalytics.tar.gz
For example, if you are on “master” branch you run:
wget https://s3.amazonaws.com/gao-internal-archive/master/trustedanalytics.tar.gz
For Dev:
You can build ATK tarball from scratch yourself. In order to do so, do the following:
CD to directory where the “atk” code is checked out.
Build the atk code using Maven tool. Details for this change frequently, so please look at other Wiki pages like this one: Maven build
CD to “package” directory and from there run this script: “config/trustedanalytics-rest-server-tar/package.sh”. This creates a tar file like “atk.tar.gz” in the current directory.
Deploy ATK to TAP (Ireland instance): Create a directory anywhere on your system, for example at “~/vcap/app” and unpack your “trustedanalytics.tar.gz” inside that directory.
CD to “~/vcap/app” and create a file “manifest.yml” with this content: (For now please ensure you are using below memory and disk_quota values and do not change them)
applications: - name: <YOUR_ATK_APP_NAME_HERE> for example "atk-ebi" command: bin/rest-server.sh memory: 1G disk_quota: 2G timeout: 180 instances: 1 services: - bryn-cdh - <YOUR_POSTGRESQL_SERVICE_NAME_HERE> for example "pg-atk-ebi" - bryn-zk env: CC_URI: <CLOUD_FOUNDRY_API_ENDPOINT> UAA_URI: <UAA_ENDPOINT> UAA_CLIENT_NAME: atk-client UAA_CLIENT_PASSWORD: c1oudc0w
Create an instance of PostgreSQL by running the command:
$ cf create-service postgresql93 free pg-atk-ebi
and you should see an output like this:
Creating service instance pg-atk-ebi in org seedorg / space seedspace as admin... OK
Change to the “~/vcap/app” folder (or wherever you have “trustedanalytics.tar.gz” unpacked).
Now run the command
cf push. This takes a few minutes to run and you should see the following output:[hadoop@master app]$ cf push Using manifest file /home/hadoop/vcap/app/manifest.yaml Creating app atk-ebi in org seedorg / space seedspace as admin... OK Using route atk-ebi.apps.gotapaas.eu Binding atk-ebi.apps.gotapaas.eu to atk-ebi... OK Uploading atk-ebi... Uploading app files from: /home/hadoop/vcap/app Uploading 48.3K, 9 files Done uploading OK Binding service bryn-cdh to app atk-ebi in org seedorg / space seedspace as admin... OK Binding service pg-atk-ebi to app atk-ebi in org seedorg / space seedspace as admin... OK Binding service bryn-zk to app atk-ebi in org seedorg / space seedspace as admin... OK Starting app atk-ebi in org seedorg / space seedspace as admin... 0 of 1 instances running, 1 starting 1 of 1 instances running App started OK App atk-ebi was started using this command `bin/rest-server.sh` Showing health and status for app atk-ebi in org seedorg / space seedspace as admin... OK requested state: started instances: 1/1 usage: 1G x 1 instances urls: atk-ebi.apps.gotapaas.eu last uploaded: Wed May 20 22:22:54 UTC 2015 stack: cflinuxfs2 state since cpu memory disk details #0 running 2015-05-20 03:25:13 PM 0.0% 622.9M of 1G 432.9M of 2G
If you like to see the complete configuration for your app, run the command “cf env atk-ebi”.
Retrieve data from VCAP_APPLICATION uris.
Create a client credentials file. For more information, see https://github.com/trustedanalytics/atk/wiki/python-client
To tail your app logs:
cf logs atk-ebi
Open a Python2.7 or IPython session and do the following:
In [1]: import trustedanalytics as ta In [2]: ta.connect("<PATH_TO_YOUR_CREDENTIALS_FILE") Connected to intelanalytics server. In [3]: ta.server.host Out[3]: 'atk-ebi.apps.gotapaas.eu' In [4]: exitReady to run some examples:
TBD