본문 바로가기

Data/Data Science

[Coursera IBM] Data Science 필기2

반응형

도움이됐던 내용만 기록중...

- API? REST API?

API란 Application Programming Interfaces의 약자

Coursera에서는 예제로 Pandas 의 함수들을 API로 예를 들어서 설명함, 추가로 파이썬을 이용한 코드에서 전처리 된 데이터를 tensorflow api를 통해서 결과를 얻을수가있다라는 예로 설명함.

REST API란

REpresentational State Transfer APIs의 약자로 http를 통해서 데이터를 이용하여 웹 서비스에서 post/get을 하는 방식으로 처리된 결과값을 얻는방법을 REST API라고 설명. 현재 상용화되는 예제로 Watson Speech Model을 예로들고, 클라이언트에서 음성파일을 Watson Speech to Text API에 보내지게끔하고, REST API에서 처리된 결과값을 다시 클라이언트쪽으로 넘겨주는 방식을 설명함

-데이터 관련 웹사이트

Open data portal list from around the world

http://datacatalogs.org/ 

 

DataPortals.org - A Comprehensive List of Open Data Portals from Around the World

This service is run by Open Knowledge Foundation | Source Code | Download Data (CSV) | Download Data (JSON) | Data License (Public Domain) | Privacy Policy

dataportals.org

Governmental, intergovernmental and organization websites

https://data.un.org/ 

 

UNdata

Population Population, surface area and density PDF | CSV   Updated: 23-Jul-2019 International migrants and refugees PDF | CSV   Updated: 20-Aug-2019 Population growth, fertility, life expectancy and mortality PDF | CSV   Updated: 20-Aug-2019 Popu

data.un.org

https://www.data.gov/ 

 

Data.gov

The home of the U.S. Government’s open data Here you will find data, tools, and resources to conduct research, develop web and mobile applications, design data visualizations, and more. For information regarding the Coronavirus/COVID-19, please visit Cor

www.data.gov

https://www.europeandataportal.eu/en/ 

 

Home | European Data Portal

Open Data Maturity in Europe The open data maturity study serves as a benchmark to gain insights into the development achieved in the field of open data in Europe. It assesses the level of maturity against four dimensions: policy, portal, impact, and quali

www.europeandataportal.eu

Kaggle

https://www.kaggle.com/datasets 

 

Find Open Datasets and Machine Learning Projects | Kaggle

Download Open Datasets on 1000s of Projects + Share Projects on One Platform. Explore Popular Topics Like Government, Sports, Medicine, Fintech, Food, More. Flexible Data Ingestion.

www.kaggle.com

Google data set search

https://datasetsearch.research.google.com/ 

 

Dataset Search

 

datasetsearch.research.google.com

What is a model?

  • Data can contain a wealth of information
  • ML models identify patterns in data
  • A model must be trained on data before it can be used to make predictions
  • Supervised, unsupervised and reinforcement learning are types of ML

 

Deep Learning

  • Tries to loosely emulate how the human brain works
  • Applications
    • Natural Language Processing
    • Image, audio and video analysis
    • Time series forecasting
    • Much more
  • Requires typically very large datasets of labeled data and is compute intensive

Comma Separated Values(CSV) is a commonly used format to store: Tabular data

 

해당 코스는 여기까지만 학습하기로하였다. 이유는 너무 IBM Watson 시스템을 사용하라고 강요당하는 기분이여서 이걸 사용하지않는한 뒤로 진도가 나가기 어려워서 구독을 끊었다. 다른 강의를 찾아봐야겠다

반응형

'Data > Data Science' 카테고리의 다른 글

[deeplearning.ai] Coursera 필기정리 1  (0) 2020.07.02
[ML] Coursera 필기 정리  (0) 2020.06.30
[Coursera IBM] Data Science 필기  (0) 2020.06.18
[Sklearn] PCA 차원축소  (0) 2020.05.07
[딥러닝] LSTM & Anomaly Detection  (0) 2020.04.29