8 minute read

Machine Learning Framework, Library, Tools

Machine Learning Framework, Library, Tools

Introduction

As of 2022, Data Science, AI, and Machine Learning are very fast-evolving domains. In the last 5 years, it has picked up momentum. Every day a new library, framework, and tools pops out before our eyes. Many of these are very interesting and some are just duplicates with little value addition. I am listing below some tools that I came across during my work. The purpose of this listing is not to describe every tool but to provide a link and just put them in sorted order. There are so many jargons, and we use to forget these. Sometimes, it becomes difficult to recall them. It was useful for me and I hope some of you will find this useful.

The list below is in alphabetical order.

  1. Beautiful Soup: A library for parsing HTML and XML documents.
  2. Bokeh: A library for creating interactive visualizations in web browsers.
  3. Folium: A library for creating interactive maps using leaflet.js.
  4. Gensim: A library for topic modelling and document similarity analysis.
  5. Keras: A high-level API for building and training deep learning models.
  6. Matplotlib: A library for creating visualizations such as charts and graphs.
  7. NLTK: A library for natural language processing tasks such as tokenization, stemming, and tagging.
  8. NetworkX: A library for working with graphs and networks.
  9. NumPy: A library for working with arrays of data.
  10. OpenCV: A library for computer vision tasks such as image processing and object detection.
  11. Pandas: A library for working with tabular data.
  12. Pillow: A fork of the Python Imaging Library (PIL), a library for opening, manipulating, and saving many different image file formats.
  13. Plotly: A library for creating interactive visualizations in web browsers.
  14. PyTorch: A library for building and training machine learning models, particularly deep neural networks.
  15. Pygame Display: An extension of Pygame that provides support for creating windows and displaying graphics.
  16. Pygame GUI: An extension of Pygame that provides a set of GUI widgets such as buttons, text boxes, and sliders.
  17. Pygame Input: An extension of Pygame that provides support for handling input events such as mouse clicks, key presses, and joystick movements.
  18. Pygame Mixer: An extension of Pygame that provides support for playing sounds and music in games.
  19. Pygame Time: An extension of Pygame that provides support for timing and scheduling events in games.
  20. Pygame Vector: An extension of Pygame that provides support for 2D vector math operations such as addition, subtraction, dot product, cross product, normalization, and rotation.
  21. Pygame Zero: An extension of Pygame that simplifies game development by providing a basic game loop and other features out of the box.
  22. Requests: A library for making HTTP requests in Python.
  23. SciPy: A library for scientific computing, including optimization, integration, and linear algebra.
  24. Scikit-learn: A library for machine learning algorithms.
  25. Scrapy: A library for web scraping and crawling.
  26. Seaborn: A library for creating more advanced visualizations.
  27. Selenium: A library for automating web browsers.
  28. Statsmodels: A library for statistical modelling and testing.
  29. TensorFlow: A library for building and training machine learning models.

A Comprehensive List Libraries, Frameworks, Pretrained Models

The list below is in alphabetical order.

  1. Accord Net
  2. ActiveMQ *
  3. acxiom
  4. Adapter Transformers
  5. Airflow *
  6. AIX360
  7. ALBERT *
  8. Albumentations
  9. AlchemyAPI for Blockchain
  10. AlertOps *
  11. Algorithms for outlier, adversarial and drift detection
  12. Alibi Detect
  13. allenNLP, github
  14. AlphaZero jl
  15. Alteryx
  16. Amazon Webservics *
  17. AMBERT *
  18. Analytics Vidhya
  19. Android Studio *
  20. Annoy *
  21. Ansible *
  22. Ansimble *
  23. Anypoint Platform
  24. Apache *
  25. Apache Airflow
  26. Apache Hadoop
  27. Apache Mahout
  28. Apache SINGA
  29. Apache Solr
  30. Apache Spark
  31. apatar
  32. AppDynamics *
  33. Argo Workflow
  34. Arrow *
  35. Astera
  36. Asteroid
  37. Atom *
  38. Attensity *
  39. Audino *
  40. AutoGL
  41. AutoGraph *
  42. Automic *
  43. AutoML
  44. AWS *
  45. AWS API Gateway
  46. AWS CLI *
  47. AWS cloudformation
  48. AWS Cloudwatch
  49. AWS codebuilt for hosting code
  50. AWS codecommit
  51. AWS codepipeline
  52. AWS Lambda
  53. AWS Lambdas *
  54. AWS Quicksight
  55. AWS S3 *
  56. AWS sagemaker
  57. Azure *
  58. Azure Fuction *
  59. Azure Logic Apps. *
  60. AzureML *
  61. Bamboo *
  62. beam *
  63. beautifulsoup *
  64. BERT *
  65. BERT++ *
  66. BigML *
  67. BiLSTM *
  68. Binder
  69. Birst *
  70. Bitbucket
  71. Blackduck *
  72. bokeh *
  73. BookNLP
  74. Boomi AtomSphere Platform *
  75. Bort *
  76. Brain
  77. Brainstorm
  78. Caffe, github
  79. Caffe2, github
  80. CAI *
  81. CAMTL *
  82. Car ND Object Detection
  83. Catalyst
  84. category-encoder *
  85. CBERT *
  86. ccv
  87. Celigo Integration Platform *
  88. CERT *
  89. Chainer
  90. char-rnn
  91. CHARTIO *
  92. Chef *
  93. ChoasMonkey *
  94. Chocolatey *
  95. Circle CI *
  96. CJU *
  97. Clarif-ai *
  98. clearstory - alteryx *
  99. CLion *
  100. Cloud Foundary *
  101. Cloudera *
  102. cloverETL *
  103. CML *
  104. Coach
  105. CodeOcean *
  106. CodePen *
  107. Comet ML *
  108. Concourse *
  109. conda *
  110. CondSandbox *
  111. Continuous Machine Learning (CML)
  112. ConvBERT *
  113. convetjs
  114. Cookiecutter
  115. CoreML
  116. CPAN *
  117. Cracking Data Science Interviews
  118. CrowdFlower
  119. CrownAnalytix
  120. cuda-convnet
  121. cuDNN
  122. Cunnotate *
  123. CVAT *
  124. Cyberark Conjur *
  125. DALEX
  126. darts *
  127. Dask *
  128. Dask *
  129. DaskML *
  130. Data Driven
  131. DataGrip *
  132. Datameer *
  133. Datasift *
  134. Datastax
  135. datatable *
  136. Dato *
  137. DBMeastro *
  138. DeBERT *
  139. deeplearn.js
  140. DeepLearning4J
  141. DeepLearnToolbox
  142. Deepnet
  143. Deeppy
  144. Detecto
  145. DFS *
  146. DGL *
  147. Diffusers
  148. Digimind *
  149. distilBERT *
  150. Diverse Counterfactual Explanations (DiCE)
  151. DMTK
  152. Dnotebook
  153. Docker *
  154. DOMO *
  155. DOWEL
  156. DSSTNE
  157. DVC
  158. Dynatrace *
  159. Eclipse *
  160. Elastic search *
  161. ElasticBERT *
  162. ElasticSearch *
  163. ELBERT *
  164. Electra *
  165. Electric Cloud *
  166. ELI5
  167. Emacs *
  168. Enigma *
  169. ERNIE *
  170. ESPnet
  171. EthicalML
  172. etleap *
  173. Excel *
  174. Experian
  175. ExplainerDashboard
  176. Explosion.ai, github
  177. Extrahop *
  178. Fairseq
  179. fancyimpute *
  180. fast.ai *
  181. fastai
  182. FastAPI *
  183. fastText, github
  184. fatual
  185. fbprophet *
  186. Feast
  187. featuretools - auto features *
  188. Flair
  189. Flask *
  190. FlinkML *
  191. FluentId *
  192. Flyway DB *
  193. Fortify *
  194. Framework for fast prototyping of Graph Neural Networks
  195. Frog Artifactory *
  196. fuzzywuzzy *
  197. Gainsight
  198. garage
  199. Gathr
  200. GCP *
  201. GCP Engine *
  202. Git *
  203. Gitee *
  204. Github
  205. Gitlab
  206. Gitpod *
  207. Gliffy *
  208. GloVe
  209. Gluon *
  210. GluonTS *
  211. GNIP *
  212. GoLand *
  213. Good Data *
  214. Google Analytics *
  215. Google Anthos
  216. Google Colab *
  217. GPT3 *
  218. Grafana *
  219. Graph ML *
  220. Graph4nlp *
  221. GraphX GraphFrames *
  222. Great Expectations
  223. Grekite *
  224. Gremlin *
  225. gspread *
  226. H2O, github
  227. H2O/Deep Water *
  228. Hadapt
  229. Harness *
  230. HashcorpValut *
  231. hebel
  232. Helm *
  233. Hi Plot
  234. Hindi OCR
  235. Hinglish NLP
  236. HoloViews *
  237. Hootsuite *
  238. Hopsworks
  239. Hortonworks
  240. Hydra *
  241. IBM Cloud *
  242. IBM-Watson *
  243. Idibon *
  244. iGraph *
  245. imbalanced-data *
  246. Implicit
  247. Import IO *
  248. Infogroup *
  249. informatica
  250. Informatica Intelligent Cloud Services. *
  251. Intellij IDEA *
  252. Intercom
  253. ipyVizzu *
  254. JavaNN
  255. JAX
  256. JBoss Server *
  257. Jenkins *
  258. jFrog Artifactory *
  259. JIRA *
  260. JMeter *
  261. Joblib
  262. Julia *
  263. JUnit *
  264. Jupyter *
  265. Jupyter Notebook
  266. JupyterHub *
  267. JupyterLab *
  268. Kafka *
  269. Kaggle
  270. Kaggle Courses
  271. Karate Club
  272. Kats *
  273. Kbana *
  274. KDD Cup
  275. Kedro
  276. Keptn *
  277. Keras, github
  278. Keras *
  279. Kibana *
  280. Kimano-labs *
  281. KISSmetrics *
  282. Knet.jl
  283. KNIME
  284. knofhub.com
  285. KongHQ *
  286. Kubeflow *
  287. Kubernetes *
  288. Label Studio
  289. Labelbox
  290. Lasagne
  291. LEX-ANALYTICS *
  292. LibLINEAR *
  293. Library for fast text representation and classification.
  294. LibSVM *
  295. LightFM *
  296. LIME
  297. Logstash *
  298. Looker *
  299. LucidCharts *
  300. LucidSpark *
  301. Luigi *
  302. Lux *
  303. MacALBERT *
  304. Mailchimp *
  305. Maluuba *
  306. MAPR
  307. Martego *
  308. Marvin
  309. MatConvNet
  310. MathWorks *
  311. MATLAB
  312. MatLab/Octave *
  313. Matplotlib *
  314. Matplotlib Jupyter Integration
  315. Maven *
  316. Measuring Data Drift
  317. Mem cache *
  318. MemSQL *
  319. Mercuiral *
  320. Mercury
  321. Merlion
  322. Mesos *
  323. Metaculus
  324. MetaFlow *
  325. MetaMind *
  326. MGL
  327. Microsoft Cognitive Toolkit
  328. MicroStrategy *
  329. Minerva
  330. Mixpanel
  331. ML Completeness Checklist *
  332. ML Reproducibility Checklist *
  333. ML Workspace
  334. ML-Agents
  335. MLFlow *
  336. MLlib *
  337. MLpack
  338. MobileBERT *
  339. Mocha.jl *
  340. Mode *
  341. Model Explainablity
  342. Model in Production
  343. Model Monitoring
  344. Mongo dB *
  345. MongoDB
  346. MS Cognitive Toolkit (CNTK)
  347. Mulesoft
  348. mxnet, github
  349. MXNet *
  350. MySQL *
  351. Nagios *
  352. NeMo
  353. Neo4j *
  354. Neon
  355. Neovim *
  356. Neptune
  357. Nepture *
  358. NetBeans IDE *
  359. Netron
  360. NetworkX *
  361. NeuPy
  362. Neural Prophet
  363. NeuralProphet: A simple forecasting package
  364. Neuraxle
  365. New Relic *
  366. Nexus *
  367. Nexus Sonatype *
  368. NEZHA *
  369. Nginx *
  370. NLP for Sanskrit
  371. NLP Overview
  372. NLTK *
  373. nolearn
  374. Notepad++ *
  375. Npm *
  376. NTLK/Gensim *
  377. Nuanace *
  378. numba *
  379. Numenta *
  380. Numpy *
  381. NuPIC
  382. Nutanix *
  383. Nvidia DIGITS
  384. Octupus Deploy *
  385. OmegaConf *
  386. ONNX, github
  387. OpenAI Gym *
  388. OpenCV *
  389. OpenDL
  390. OpenMake *
  391. OpenStack *
  392. OpsLevel *
  393. Optimizely
  394. Optimus *
  395. Oracle *
  396. Oracle Weblogic Server *
  397. Orange *
  398. Oryx2 ML *
  399. Overleaf *
  400. P5js Editor *
  401. Pachyderm
  402. Packer *
  403. Paddle
  404. PaddlePaddle *
  405. PaddlePaddle.
  406. PagerDuty *
  407. Palantir *
  408. PalBert *
  409. Pandas *
  410. Panel
  411. Papermill *
  412. Paxata *
  413. pdfminer *
  414. Pentaho *
  415. PhpStorm *
  416. Pillow *
  417. pip *
  418. Platfora *
  419. Plutora *
  420. pmdarima *
  421. Poetry
  422. Postman *
  423. PregEx *
  424. Prodigy, github
  425. Prometheus *
  426. Puppet *
  427. pyannote.audio
  428. Pycaret
  429. Pycharm *
  430. Pydantic
  431. pyexcel *
  432. PyImpetus
  433. pypdf2 *
  434. pyRDF2Vec *
  435. PySpark *
  436. Python *
  437. PyTorch, github
  438. Pytorch Geometry
  439. Pytorch Lightning
  440. pyVis *
  441. PyViz *
  442. Qlik *
  443. Qlikview *
  444. Quid *
  445. R Studio *
  446. Rabbit MQ *
  447. Radian *
  448. Rapid Insight *
  449. RapidMiner *
  450. RAPIDS *
  451. Readhad Automation *
  452. Redate DB *
  453. RelateIQ
  454. Replit *
  455. Repo2docker *
  456. Requests-html *
  457. Revealjs
  458. Rider *
  459. River
  460. RJMETRICS *
  461. RNNLIB
  462. RNNLM Toolkit
  463. RoBERTa *
  464. RRCF *
  465. rubix, github
  466. RubyGems *
  467. Rust
  468. S2 Geometry *
  469. Salesforce
  470. Salford Systems *
  471. SaltStack *
  472. SAP *
  473. SAP Integration Suite. *
  474. SAS *
  475. SAS/SPSS/PSPP *
  476. Satisfaction *
  477. scarpy *
  478. Scikit Flow
  479. Scikit-learn
  480. Sciktlearn-Image *
  481. SciLab *
  482. Scipy *
  483. Seaborn *
  484. segaBERT *
  485. segLearn *
  486. Segment io
  487. Seldon Core
  488. SeldonIO/alibi
  489. SeldonIO/alibi-detect
  490. SeldonIO/tempo
  491. Selenium *
  492. Selinium Webdriver *
  493. SemBERT *
  494. Sense2Vec
  495. Sent2Vec Encoder
  496. Sentence Transformers
  497. Serpent.AI
  498. ServiceNow *
  499. SesameBERT *
  500. SHAPASH
  501. Shogun *
  502. Silk *
  503. Singa *
  504. Singularity *
  505. Singularity, *
  506. Skater
  507. sklearn *
  508. Sklearn Data Transformations *
  509. sklearn-pandas *
  510. sktime *
  511. SKY-MIND *
  512. Skytree *
  513. Slack *
  514. Slides
  515. snaplogic
  516. Snorkel *
  517. Snowflake *
  518. Software and Data Carpentry instructor training course material *
  519. Sonarqube *
  520. Sonnet
  521. spaCy, github
  522. Spacy Course
  523. SpanBERT *
  524. Spark Graph *
  525. Spark ML/MLLib *
  526. Spark SQL *
  527. Spark Streaming *
  528. speechbrain
  529. Spinnaker *
  530. Splunk *
  531. Spotfire *
  532. SPSS *
  533. Spyder *
  534. SQLServer *
  535. Squash Commits *
  536. SqueezeBERT *
  537. srsly
  538. Stable-Baselines3
  539. StackingBERT *
  540. Stanza
  541. Starlette *
  542. STATA
  543. Statistica *
  544. Statsmodels *
  545. STMoE *
  546. Stoplight *
  547. Streamlit *
  548. StructBERT *
  549. STUMPY *
  550. Sublime Text *
  551. SUGAR-CRM *
  552. SumoLogic *
  553. Swagger *
  554. SyBase *
  555. Synapses
  556. Syntaxnet
  557. Sysomon *
  558. T5 *
  559. Tableau *
  560. Tabula *
  561. Tagtog *
  562. talend
  563. Tamr
  564. TeamCity *
  565. Tensorboard
  566. TensorBoard Huggingface
  567. Tensorflow
  568. Tensorflow *
  569. TensorFlowTTS *
  570. TensorForce
  571. TensorWatch
  572. TeraData *
  573. Terraform *
  574. TestTube *
  575. textract *
  576. TF Lite
  577. TFLearn, github
  578. TFX (Tensorflow Extended)
  579. The Carpentries website
  580. Theano
  581. Thinc
  582. Tiangolo
  583. TIBCO Cloud Integration. *
  584. Timm
  585. TinyBERT *
  586. TM Apache Spark *
  587. Tomcat *
  588. torch *
  589. Torch/PyTorch *
  590. Torch7
  591. Torchnet
  592. Totango *
  593. TPOT
  594. Transformers
  595. Travis *
  596. Trello *
  597. Trifacta
  598. Tripwire *
  599. TSFresh *
  600. tslearn *
  601. Turing NLR *
  602. TVM
  603. Tyk *
  604. Universal Data Tool
  605. UrbanCode *
  606. VAEX
  607. Veles
  608. Vicarious *
  609. Vim *
  610. Visdom *
  611. Visual Code Insiders *
  612. Visual Studio Code *
  613. Visual Studio Tools for AI
  614. VisualParadigm *
  615. Visutal Studio *
  616. Vowpal Wabbit *
  617. VScode *
  618. Webhouse.io *
  619. WebStorm *
  620. Weights & Biases *
  621. Weka
  622. Weka3/MOA *
  623. Wolfram Language
  624. Workato. *
  625. WorkFusion
  626. WPS *
  627. XAI
  628. Xcode *
  629. XGBoost *
  630. XLM *
  631. XLNet *
  632. xlsxWriter *
  633. xlwings *
  634. Yarn *
  635. Yellowbrick
  636. Yum *
  637. Zabbix *
  638. Zapier
  639. Zend *
  640. Zendesk *
  641. ZenML, github
  642. Zenoss *
  643. Zeppelin *
  644. Zingg
  645. Zoomdata

Updated: