Limited Offer Get 25% off — use code BESTW25
No AI No Plagiarism On-Time Delivery Free Revisions
Claim Now
Prices start at $5 per page · plagiarism-free papers · free revisions for 14 days 24/7 support: support@bestwriters.com
Uncategorized

FIT5145 Assignment 3

  • Posted
  • Authoradmin
  • Length762 words
  • Reading time4 min
Write My Assignment FREE

FIT5145 Assignment 3
Semester 1, 2020
Due: Friday 22 May 2020 11:55pm (Week 9)
Weight: 15%
Hand in Requirements:
Please hand in a PDF file containing your answers to all the questions, numbered
correspondingly. You can use MS Word or any other word processing software to format
your submission. Save the final copy to a PDF before submitting.
● Make sure to include screenshots/images of the graphs you generate and
justification/explanation of your answers where required.
● Make sure to include copies of all the bash commands and R scripts you use and a
screenshot of the output the code generates. If your answer is wrong, you may still get
a portion of the marks if your commands or script is partially correct.
● Note: ​Do not​ zip your submission.
Assignment Tasks
The dataset for this assignment can be accessed from the following link:
Link: https://drive.google.com/open?id=1OA2EYkIvry6NHLmRkQs-LMHch9dxZ6gs
Overview:
Twitter is making it possible for developers and researchers to study the public conversation
around COVID-19 in real time. This dataset includes a CSV file which contains tweets
extracted from the Twitter website in March 2020. The dataset is large and thus you are
initially required to manipulate it using shell scripting. Once you have reduced the data to a
reasonable size, you are then asked to use R programming language to further analyse and
visualise the results.
Task A: Investigating Twitter Data using shell commands
Download the file covid-data.zip ​from the link provided above. Use the Unix shell to
manipulate the file and answer the following questions.
1. Decompress the file. How big is it?
2. What delimiter is used to separate the columns in the file? Write the code to show
how many columns are there?
3. How many tweets are there in total in the file?
4. Assuming that the data is sorted, what is the date range of the tweets? (date of first and last
tweet)
5. When was the first mention of the term “COVID-19” in your dataset (notice that we look for
COVID-19 with capital letters here)? What is the user_id, text and post date of this tweet?
6. How many times did the hashtag #coronavirus or #COVID-19 appear in the file in the
given form?( If any of these words appear more than once in a line, you need to count
all its occurrences to answer this question properly)
7. As per the dataset, how many unique users (user_ids) have tweeted? List the top 10
most frequent Twitter users (user_ids) whose tweets are in English (​lang = ‘en’​)?
8. How many times does the word “Advertisers” appear in the ​source​ column? What is
the full name of the source which contains the text “Advertisers”? Print the text and
post date of the first and last English tweet posted from this source.
9. Filter all the tweets with ​lang = ‘en’​ which contain the term ‘Corona’ or ‘Covid’.
Export the tweets to a new file named “​covid19Final​.csv”. Ensure that you restrict the
tweets only to verified users who have retweeted at least 20 times. Ensure that the file
“​covid19Final​.csv” ​contains the column names as well.
Task B: Exploratory Data Analysis using R
Now that we have extracted the required data, let us use R for the remainder of the analysis.
1. Read file ‘covid19Final​.csv’ into R and print out the number of rows and columns in
the dataset.
2. Which column from the dataframe is most suited to be used as a unique identifier.
Convert the datatype of that column to an appropriate data format (preferably
numeric). Briefly describe and fix any issues you encounter during this conversion
process. Has the dimension of the dataframe changed? If so, what is the new
dimension?
3. Create a line chart which shows the trend of the number of tweets posted over time.
Describe the trend you observe.
4. Create another line chart showing the number of retweets over the same time period.
Explain your observation. Does the line chart in question B-3 and the one in this
question display similar trends? Why do you think this is so? Please explain your
answer.
Use a proper statistical test to verify if the two distributions are similar to each other?
You may find this resource useful for answering the question:
https://towardsdatascience.com/statistical-tests-when-to-use-which-704557554740
5. Let us investigate the type/category of device used by twitter users to post their
tweets. Create a bar graph that shows the number of tweets posted using the following
devices: iPhone, Mac, IPad and Android in descending order. What can you infer
from the graph? Who might be interested in such statistics and why?
The End

The post FIT5145 Assignment 3 appeared first on My Assignment Online.

Plagiarism Free Assignment Help

Expert Help With This Assignment — On Your Terms

✓ Native UK, USA & Australia writers ✓ Deadline from 3 hours ✓ 100% Plagiarism-Free — Turnitin included ✓ Unlimited free revisions ✓ Free to submit — compare quotes

admin

Academic writer and editor at BestWriters.

Get your paper off your plate tonight

Post your instructions for free. Prices start at $5 per page.

Place an order