@jaredbusch I am so used to creating my bridges manually I keep forgetting macvtap creates them for you.

@eddiejennings

@eddiejennings said in Networking and 1U Colocation:

I'm trying to think through how I'd configure my network using a VM on my KVM host as my router/firewall. This is the first draft of how I see this working.

The networks with which I've worked in the past have a firewall that would have one interface with a public IP (100.100.100.2/30) and one with a private IP (192.168.1.1/24), which connects to a switch, which connects to everything else. NAT would be used to direct traffic to specific hosts, such as NATing inbound traffic for 100.100.100.2:80 to a webserver at 192.168.1.10.

I'm trying to wrap my head around how to make that concept work in an virtualized environment where I have a single hypervisor and no networking appliance. I'd obviously have a virtual switch which wouldn't have any connection to a physical NIC on the host for the guest VMs (the 192.168.1.0/24 network). I'd have another virtual switch which would have a connection to the physical NIC. The firewall VM would have a connection to each virtual switch.

The question becomes what NIC receives the public IP address I'll be assigned. My first thought was the interface of the firewall VM that's attached to the virtual switch that's attached to the NIC of the physical host. However, that seems problematic, as at the moment, I don't know how a packet destined for 100.100.100.2 coming in on eth0 of the host would be forwarded to the virtual switch.

There are other questions; however, I think this has to be addressed first.

Maybe try this, lets see if I can explain myself well.

Attach your physical interface to a linux-bridge (lets call it br0) and then assign the br0 interface only to your firewall vm. Set the static address 100.100.100.2 on the vms interface this will be your wan port .

Create a private network and set it to isolated, it will create a virbrX interface in your host. Add an interface to your vm inside the isolated private network (using virbrX), this will be your firewalls lan interface.
Your virtual network gives you internal and host only routing, so you will have access to your guest through this ip range.

Any new vm you create add it interface to be part of your virtual network and set their gateway to your firewall-vms lan port.

I believe that should do what you want.

@lakshmana said in Extract Data from .csv file with Python:

@romo said in Extract Data from .csv file with Python:

pip install pandas

raise DistutilsError("Setup script exited with %s" % (v.args[0],))
distutils.errors.DistutilsError: Setup script exited with error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools

Some of the dependencies when installing it with pip are required to be compiled that is why for beginners it is just better to use either Anaconda or miniconda, especially for a Windows install.

I usually install Anaconda in windows because I use other things included in it and it is the easiest way of having everything setup for you, but it might really be overkill for you to install it because it is pretty big.

You can also install miniconda and download the required packages from it.

The official documentation marks the above two methods as the easiest for beginners but you can also install it from Pypi. pip install pandas

You have to read the file differently, and then read the sheet you want passing the file object and then the sheet name.

---

DATASET: pandas-test-xlsx, Sheet - Test-Sheet

# Read the whole file
$ file = pandas.ExcelFile('pandas-test.xlsx')

# Specify the file and then the sheet you want to work with
$ mysheet = pandas.read_excel(file, 'Test-Sheet')

# Work with the dataframe now contained in the mysheet variable
$ mysheet

---

EDIT: Just doubled checked an you can pass the file name as a string to the read_excel function so that would be alot easier.

pandas.read_excel('pandas-test.xlsx', 'Test-Sheet')

Now that I have some free time, I'll give you a simple example of some of the things you can do using pandas.

Our dataset will be all the posts in this topic, scraped and saved into an excel file.

DATASET : pandas-test.xslx

I am going to be using a Jupyter notebook just to make the output clearer.

$ import pandas
$ pandas.read_excel('pandas-test.xlsx')

That is the whole spreadsheet read and basically printed out, but we can't work with that. We need to read the file into a variable and start working with it.

# Reading the file to variable df
$ df = pandas.read_excel('pandas-test.xlsx')

# Printing how many rows and column in the file (rows,columns)
$ df.shape
(11,4)

# Printing the column names
$ df.columns
Index(['Date', 'Time ', 'User', 'Post'], dtype='object')

Only extracting columns - Date and User

$ df[['Date', 'User']]

Lets check how many posts per day

$ df.groupby(['Date'])['User'].count()

Now lets check by day and time

$ df.groupby(['Date', 'Time ']).count()

---

Lets filter only your posts and create a new csv file based on the data found.

$ subset = df.loc[df['User']=='Lakshmana']

Create a csv file only containing your posts

$ subset.to_csv('Lakshmana-posts.csv')

Final results your new csv file with your posts filtered out.

Lakshmana-posts.csv

---

EDIT: Just if you need it, an example of filtering by date and user

@lakshmana said in Extract Data from .csv file with Python:

I am new to Python but need to autofilter the data from the excel sheet according to the Engineer name and Age of the tickets in the excel.I need to filter the data above 15 Days and copy to the another sheet of the excel.Is this possible through Python

It is indeed possible to do with python. You have great libraries built just for data analysis and manipulation for cases like this.

• pandas
• xlwings
• openpyxl
• XlsxWriter

@romo said in What Are You Doing Right Now:

@scottalanmiller said in What Are You Doing Right Now:

@romo said in What Are You Doing Right Now:

Just finished setting up a lab using Cisco's Packet Tracer to recreate layer 3 routing and inter-vlan communication. Everything is working properly according to the desired setup so I think I now know how to fix the problems I was having in the production network.

Is this on the Juniper switches, or a different network?

Juniper switches

Had to build the lab to get proper testing of why the intervlan routing was not working properly when it should.

Have it working perfectly on the cisco equipment so it shouldn't be hard to replicate the setup, at least not on the Juniper equipment. The mess is in the current Fortinet config and policies.

@scottalanmiller said in What Are You Doing Right Now:

@romo said in What Are You Doing Right Now:

Just finished setting up a lab using Cisco's Packet Tracer to recreate layer 3 routing and inter-vlan communication. Everything is working properly according to the desired setup so I think I now know how to fix the problems I was having in the production network.

Is this on the Juniper switches, or a different network?

Juniper switches

@scottalanmiller said in Networking and 1U Colocation:

@bnrstnr said in Networking and 1U Colocation:

https://www.colocationamerica.com/colocation/1u-colocation.htm
No idea about other colo, but this one has "KVM over IP Included"

Yup, that's who we use and we use that KVM from time to time. Very easy to use.

Really usefull, but I still really hate the old java dependencies that make it not that easy to use until you know to what version you need to downgrade to.