Mdthbs

My plan is to copy file from ec2 to s3 bucket using ansible, Here I've make playbook but getting some error:

copy2s3.yml

---

- name: Copy to s3

   s3:

     aws_access_key: "{{ lookup('env','aws_key') }}"

     aws_secret_key: "{{ lookup('env','aws_secret') }}"

     bucket: "{{ aws_packages_bucket }}"

     object: "/JI79IML/my_part_X86_64_c7.15.tar.gz"

     dest: "/data/parts/JI79IML/my_part_X86_64_c7.15.tar.gz"

     mode: get

     overwrite: no

Getting below error:

$ ansible-playbook copy2s3.yml -i 172.18.2.12,



 ERROR! 's3' is not a valid attribute for a Play



The error appears to have been in '/home/ubuntu/bk/copy2s3.yml': line 2, column 3, but may

be elsewhere in the file depending on the exact syntax problem.



The offending line appears to be:



---

- name: Copy to s3

^ here

Module name (s3) should be at the same indentation level as the name:

- name: Copy to s3

  s3:

    aws_access_key: "{{ lookup('env','aws_key') }}"

    aws_secret_key: "{{ lookup('env','aws_secret') }}"

    bucket: "{{ aws_packages_bucket }}"

    object: "/JI79IML/my_part_X86_64_c7.15.tar.gz"

    dest: "/data/parts/JI79IML/my_part_X86_64_c7.15.tar.gz"

    mode: get

    overwrite: no

To Copy Object from Local Server to S3 using Ansible module, Use

mode: put

get will be used to download the object.

Reference

I had a similar issue when using aws_s3, the replacement module for s3.

Check to see if you have boto (for s3 and aws_s3) and boto3 (for aws_s3) correctly installed.

I had both boto & boto3 installed but, due to playing with virtual environments, they were only installed for Python3.5 and no other versions of python. Thus python (Python2.7 on my setup) that Ansible uses could not import the boto's and failed with this very esoteric error message.

To ensure that all is correctly installed is run python on the command line and try to import the boto's manually:

13:20 $ python

Python 2.7.12 (default, Nov 19 2016, 06:48:10) 

[GCC 5.4.0 20160609] on linux2

Type "help", "copyright", "credits" or "license" for more information.

>>> import boto

>>> import boto3

>>> 

13:21 $ python3

Python 3.5.2 (default, Sep 14 2017, 22:51:06) 

[GCC 5.4.0 20160609] on linux

Type "help", "copyright", "credits" or "license" for more information.

>>> import boto

>>> import boto3

>>> 

If you receive an error in python then you get the error in Ansible.

Add task: above - name like this:

---

- hosts: localhost

  tasks:

    - name: Copy to s3

      s3:

          aws_access_key: "{{ lookup('env','aws_key') }}"

          aws_secret_key: "{{ lookup('env','aws_secret') }}"

          bucket: "{{ aws_packages_bucket }}"

          object: "/JI79IML/my_part_X86_64_c7.15.tar.gz"

          dest: "/data/parts/JI79IML/my_part_X86_64_c7.15.tar.gz"

          mode: put

          overwrite: no

this source maybe helps you

---

 - name: Bucket copy

   hosts: localhost

   become_method: sudo

   become_user: root

   become: true

   gather_facts: False

   vars_files:

     - varlist.yml

   tasks:

     - name: Get s3 objects     # Make list of directory and files in register

       aws_s3:

         bucket: "{{ Bucket_name }}"

         mode: list

         aws_access_key: "{{ aws_access_key }}"

         aws_secret_key: "{{ aws_secret_key }}"

       register: s3_object_list

     - name: Create download directory  # Create directory for download latest code on s3 bucket 

       file:

         path: "S3/{{ item }}"

         state: directory

       with_items:

         - "{{ s3_object_list.s3_keys }}"

       ignore_errors: true

     - name: Download s3 objects       # Download files in there appropriate directory on serverside  

       aws_s3:

         bucket: "{{ Bucket_name }}"

         object: "{{ item }}"

         mode: get

         dest: "S3/{{ item }}"

         aws_access_key: "{{ aws_access_key }}"

         aws_secret_key: "{{ aws_secret_key }}"

       with_items:

         - "{{ s3_object_list.s3_keys  }}"

       ignore_errors: true

     - name: Folder permissions

       file:

         path: S3/*                                         

         state: touch

         mode: "u=rw,g=r,o=r"