Open in app

Sign In

Write

Sign In

krishnaprasad k
krishnaprasad k

115 Followers

Home

About

Published in CodeX

·Jan 15

Four Alternatives to pandas for processing large datasets

Ten things I hate about pandas For years pandas have become the de-facto library for python developers for data analytics and manipulating Dataframes. However, pandas could be better at handling large datasets. my rule of thumb for pandas is that you should have 5 to 10 times as much RAM as the size of your datasets …

Data Science

2 min read

Four Alternatives to pandas for processing large datasets
Four Alternatives to pandas for processing large datasets
Data Science

2 min read


Published in CodeX

·Apr 3, 2022

Extractors in Scala

If you are a scala developer you may be accustomed with the use of case class in pattern matching. For example Some(x) is a valid pattern because Some(x) is a case class, let us see an example of case class for extracting an email address. case class Email(User: String, domain…

Scala

2 min read

Extractors in Scala
Extractors in Scala
Scala

2 min read


Published in Towards Dev

·Feb 20, 2022

Introduction to Graph powered machine learning

We are surrounded by graphs. Facebook, LinkedIn, Twitter are the most famous examples of social networks. Graphs are powerful structures that can not only be used for storing connection information but also supports multiple kinds of analysis. Graphs support machine learning by doing what they do best. Representing data in…

Graph Databases

3 min read

Introduction to Graph powered machine learning
Introduction to Graph powered machine learning
Graph Databases

3 min read


Feb 13, 2022

Regression to the mean

Psychology of effective training One of the questions I was asking myself was the pyshology of effective training, how to train skills efficiently ? One of the important principle of skill training is rewards for improved performance work better than punishment for mistakes. …

Psychology

3 min read

Regression to the mean
Regression to the mean
Psychology

3 min read


Published in Towards Dev

·Jan 16, 2022

Graph Databases and Object Graph Mapping with neo4j and python

Why Graph Databases

Graph Database

4 min read

Graph Databases and Object Graph Mapping with neo4j and python
Graph Databases and Object Graph Mapping with neo4j and python
Graph Database

4 min read


Published in Towards Dev

·Dec 31, 2021

Spark Resilient Distributed Datasets

What is Spark RDD Even though spark high level APIs(Dataframe APIs ) favor you in almost all scenarios, there are times when high level manipulation will not meet business or engineering problem trying to solve. …

Apache Spark

4 min read

Spark Resilient Distributed Datasets
Spark Resilient Distributed Datasets
Apache Spark

4 min read


Published in Nerd For Tech

·Nov 28, 2021

Introduction to structured streaming with apache-spark

What is structured streaming Structured streaming is a stream processing framework built on top of apache spark SQL engine, as it uses existing dataframe APIs in spark almost all of the familiar operations are supported in streaming. …

Big Data

5 min read

Introduction to structured streaming with apache-spark
Introduction to structured streaming with apache-spark
Big Data

5 min read


Nov 14, 2021

Linear Support Vector Machine(SVM) and Decision Tree Classifiers with Spark and Scala

Decision tree and Support Vector Machines are two two supervised machine learning algorithms used for both classification and regression. Support Vector Machines vs Maximum Marginal Classier Support Vector Machine is a supervised Machine Learning algorithm used for both classification and regression, mostly used for addressing classification problems. …

Data Science

5 min read

Linear Support Vector Machine(SVM) and Decision Tree Classifiers with Spark and Scala
Linear Support Vector Machine(SVM) and Decision Tree Classifiers with Spark and Scala
Data Science

5 min read


Published in Nerd For Tech

·Nov 7, 2021

Understanding kerberos: The single sign on authentication system

The full definition of kerberos is a secure, single sign on, trusted, third party, mutual authentication service. Let’s break that definition and quickly check on each one. Secure: Kerberos is unique in it’s use of tickets , a cryptographic measure of transmitting messages over network to provide users identity. …

Kerberos

4 min read

Understanding kerberos: The single sign on authentication system
Understanding kerberos: The single sign on authentication system
Kerberos

4 min read


Published in Nerd For Tech

·Oct 30, 2021

Yet Another Resource Negotiator(YARN): Internals, Architecture and REST APIs

In early 2006 Apache Hadoop was introduced as a framework for distributed processing of large datasets across clusters of computers using a programming model. Hadoop was developed as a solution to handle big data in a cost effective and easiest way as possible. …

5 min read

Yet Another Resource Negotiator(YARN): Internals, Architecture and REST APIs
Yet Another Resource Negotiator(YARN): Internals, Architecture and REST APIs

5 min read

krishnaprasad k

krishnaprasad k

115 Followers

Data engineer | Deep learning enthusiast | Back end developer |

Following
  • Nikita Mallya

    Nikita Mallya

  • Kubernetes Advocate

    Kubernetes Advocate

  • Krzysztof Atłasik

    Krzysztof Atłasik

  • Zaheer Abzal

    Zaheer Abzal

  • AirbnbEng

    AirbnbEng

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech