Project

General

Profile

Actions

Task #1220

closed

Initial integrated test

Added by Alex Afanasyev about 10 years ago. Updated about 10 years ago.

Status:
Closed
Priority:
Normal
Category:
Integration Tests
Target version:
Start date:
Due date:
% Done:

100%

Estimated time:
8.00 h

Description

Create skeleton for integrated tests.

  1. Create a code repository for integrated tests, with directory for each scenario. test
  2. Write a scenario integrated test for NFD using ndn-tlv-ping on a single host. This should include scripts to set up the environment, run the test, cleanup the environment. This scenario can assume that dependencies, ndn-cpp-dev, and NFD are already installed.
  3. Writing a script in top level directory to execute all (or selected) tests from the repository.
Actions #1

Updated by Junxiao Shi about 10 years ago

  • Description updated (diff)
  • Category set to Build
Actions #2

Updated by Yi Huang about 10 years ago

  • Assignee changed from Jerald Paul Abraham to Yi Huang
Actions #3

Updated by Yi Huang about 10 years ago

I have documented the steps to test using traffic generator, ndn-cpp-dev, and ndnd-tlv on one machine. Moving to more complex system (two or more machines, or more apps).

Actions #4

Updated by Yi Huang about 10 years ago

ndn-traffic-generator is tested to run correctly on two VMs connected by ethernet. Jerald is implementing verification feature on client side to allow the application to verify correctness of the content.

Actions #5

Updated by Yi Huang about 10 years ago

  • Status changed from New to In Progress
Actions #6

Updated by Yi Huang about 10 years ago

Currently I have two VMs connected by Ethernet. The integrating test script runs NFD on both VMs and then run ndn-traffic-generator to test connectivity. One test takes one minute. After the test, the script will present the report about percentage data and interest loss, data correctness, etc.

Actions #7

Updated by Yi Huang about 10 years ago

Doing experiment on test bed on copying code coverage report from slave to master node for display.

Actions #8

Updated by Yi Huang about 10 years ago

Looks like the cobertura plugin does not fully support multi-configuration jobs (not shown as fancy as for free-style jobs). I tried to copy the coverage.xml file from slave to master using "copy to slave" plugin but it does not work. The steps to view the code coverage report for multi-configuration jobs are:

  1. Click on the build link that jenkins posted on gerrit so you can go to the jenkins page for the build.

  2. Click on the slave that does code coverage check for that build (Under "configuration").

  3. Click on "Cobertura Coverage Report" to view the detailed report.

Actions #9

Updated by Junxiao Shi about 10 years ago

This is undesirable but acceptable.

Please deploy the feature on main Jenkins, and update CodeCoverage on how to access the reports.

Actions #10

Updated by Junxiao Shi about 10 years ago

  • Subject changed from Integrated tests for NFD (initial setup) to Initial integrated test
  • Description updated (diff)
  • Category changed from Build to Integration Tests

This task can close upon finishing the first scenario. Other scenarios should have separate tasks.

Actions #11

Updated by Yi Huang about 10 years ago

The integrating test consists of the following parts:

  1. NRD
    Run application with environment variable NFD=1 and NRD=1. The FIB should be updated. Since currently there is no way to look into FIB, try to use the application and see if it works. If the application does not work, there must be something wrong. If it does work, there might be something wrong. This part will become easier when the status server works.

  2. TCP and UDP Faces
    I think this is the task #1362 created by Junxiao

  3. Local face
    Similar to part 2, but with only one node and TCP face only.

  4. Multicast
    A, B, and C are connect to the same Ethernet (Junxiao said A, B, and C are connect to one L2 hub if all three nodes are VMs in virtualbox). Use multicast on A and observe the application output on B and C.

  5. /localhop and /localhost
    There should be three nodes A, B, and C and two links A-B, B-C. For /localhost, only application running on A but not B and C can see the interest. For /localhop, only applications running on A and B but not C can see the interest.

Actions #12

Updated by Junxiao Shi about 10 years ago

Each scenario should have its own Task similar to #1362, so that progress can be tracked.

Actions #13

Updated by Yi Huang about 10 years ago

  • Description updated (diff)
Actions #14

Updated by Junxiao Shi about 10 years ago

Again, this task only refers to ONE TEST SCENARIO. It should be closed when this specific scenario is working.

Actions #15

Updated by Junxiao Shi about 10 years ago

  • Description updated (diff)

I'm reverting Task Description to the version entered with note-10.

"Integrated test overview" is moved to IntegratedTests page.

Actions #16

Updated by Yi Huang about 10 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

The integ-test repository is up. I think this task should be resolved.

Actions #17

Updated by Junxiao Shi about 10 years ago

I'm unable to clone NFD/integration-tests repository.

shijunxiao@m0213:~$ git clone ssh://sunny@gerrit.named-data.net:29418/NFD/integration-tests
Cloning into 'integration-tests'...
warning: remote HEAD refers to nonexistent ref, unable to checkout.

Please investigate.

Actions #18

Updated by Alex Afanasyev about 10 years ago

This is something to do with gerrit. It needs initial commit approved for the command to succeed. Right now master branch doesn't exist, so there is nothing to clone (actually, to checkout).

With the following you can fetch Jerald's commit:

git clone ssh://sunny@gerrit.named-data.net:29418/NFD/integration-tests -n
cd integration-tests
git fetch ssh://sunny@gerrit.named-data.net:29418/NFD/integration-tests refs/changes/87/587/5 && git checkout FETCH_HEAD -b some-branch
Actions #19

Updated by Junxiao Shi about 10 years ago

  • Status changed from Resolved to Closed
  • Assignee changed from Yi Huang to Jerald Paul Abraham

Ib54bd606f6854672ed890d3971ff5827197435e8

Actions

Also available in: Atom PDF